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A.  SYNOPSIS 

Rising  acquisition  costs,  poor  field  reliability  of  military 
systems,  shrinking  quantities  of  weapons — these  are  the  symptoms  that 
impelled  the  Director  of  Defense  Research  and  Engineering  to  initiate 
the  Electronics-X  Project  at  IDA  with  the  purpose  of  reviewing  the 
process  of  acquisition  and  maintenance  of  military  electronics  and 
recommending  specific  policies  and  procedures  to  remedy  the  situa¬ 
tion.  The  magnitude  of  military  electronics,  its  pervasive  nature, 
and  its  rapid  growth  led  to  its  being  singled  out  as  an  area  in  which 
massive  savings  might  be  achieved. 

Out  of  a  total  DOD  FY  74  budget  of  $81.1  billion,  electronics 
outlays  total  $15.3  billion.  They  can  be  categorized  as  follows:1 


Billions 

Electronics  RDT&E 

$  4.1 

Electronics  Procurement 

5.8 

Electronics  Support 

5.4 

Electronics  Total 

$15.3 

The  increasing  complexity  and  parts  count  of  weapons  systems 
electronics  have  caused  declines  in  s/stem  reliability  in  spite  of  the 
growth  in  reliabilities  of  individual  electronic  parts.  The  annual 
support  costs  for  military  electronics  are  now  almost  equal  to  the 
annual  procurement  costs  and  constitute  more  than  one-third  of  all 
annual  expenditures  on  military  electronics.  Since  military  mainte¬ 
nance  is  labor  intensive,  the  increase  in  military  compensation 
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designed  to  achieve  and  maintain  comparability  with  civilian  wages  can 
be  expected  to  further  inflate  the  costs  of  electronics  support. 

The  charter  for  Electronics-X  called  for  recommendations  that 
could  be  readily  translated  into  implementable  policies,  procedures, 
and  practices.  The  study  took  into  account  broad  principles  recom¬ 
mended  by  earlier  investigations  and  sought  specific  data  leaning  to 
suggested  approaches  to  a  reduction  of  the  costs  of  electronics  ac¬ 
quisition  and  support  that  would  be  consistent  with  the  role  of  mili¬ 
tary  electronics:  enhancing  the  combat  capability  and  crisis  readiness 
of  military  forces. 

The  study  identified  problem  areas,  assessed  the  magnitude  of  the 
problems,  attempted  to  determine  their  principal  causes,  and  then 
formulated  recommendations  for  eliminating,  as  far  as  possible,  those 
causes.  Obviously,  then,  the  recommended  courses  of  action  are  not 
unique  solutions  of  the  problems  but  rather  represent  the  consensus 
of  best  judgments  of  the  Study  Group.  Some  of  the  recommendations 
necessarily  call  for  an  experimental  or  evolutionary  approach  to 
solving  particular  aspects  of  problems,  since  the  response  to  major 
changes  in  operating  procedures  of  the  complex  DOD  RED,  procurement, 
and  support  apparatus,  and  in  the  interaction  of  that  apparatus  with 
suppliers,  cannot  be  predicted  with  confidence.  The  process  of  achiev¬ 
ing  improvement  is  one  requiring  feedback  data  and  corrective  action 
as  it  proceeds.  Thus,  the  need  for  innovative,  aware,  and  responsive 
management  plays  a  very  important  part  in  the  recommendations .  It  is 
believed  that  the  indicated  directions  of  change  clearly  counter  some 
of  the  major  causes  of  problems  in  electronics  cost  and  reliability 
and  constitute  reasonable  initial  steps  in  the  evolutionary  process. 

This  report  is  concerned  with  three  kinds  of  costs:  development, 
production^  and  support.  Empirical  evidence  suggests  that,  statis¬ 
tically,  production  and  support  costs  are  positively  correlated,  but 

that  development  effort  can  fie  applied  to  reduce  either  one  or  the 
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other  or  the  sum  of  the  two.  Because  support  costs  occur  in  distant: 
years  anr!  are  neither  a>  counted  for  by  the  projei  t  manager  nor  paid 


) 


out  ot  current  funds,  the  present  management  emphasis  is  on  holding 
down  just  the  total  of  development  and  production  costs,  even  though 
lifetime  support  costs  may  dominate.  Methods  to  internalize  the  sum 
of  unit  acquisition  and  support  costs  to  a  single  responsible  party 
are  needed  if  that  sum  is  to  be  reduced. 

Electronics-X  has  concentrated  on  five  major,  high-impact  areas. 
Recommendations  in  each  of  those  areas  are  presented  in  capsule  form 
below: 

1.  Data  Collection  and  Feedback."  A  valid  cbst  and  reliability 
data  base  by  electronic  subsystem  is  needed  now — not  ten 
years  hence.  An  interim  sampled-data  collection  procedure 
for  field  reliability  and  marginal  maintenance  costs  is  rec¬ 
ommended  that  will  provide  valid  input  data  and  rapid  feed¬ 
back  to  manufacturers  and  to  producer  commands  on  selected 
subsystems.  The  more  gradual  introduction  of  a  complete  and 
uniform  cost  accounting  system  is  also  recommended. 

2.  Requirements .‘"v  Modification  and  extension  of  structured 
management  reviews  are  recommended  to  help  uncover  the  real 
minimum  needs  and  to  avoid  hidden  but  costly  risks.  Per¬ 
formance,  physical  characteristics,  cost,  quantity,  and 
schedule  need  to  be  specified  in  the  initial  requirements 
statement,  and  tradeoffs  should  be  carried  on  throughout  the 
acquisition  cycle — all  with  a  realistic  but  not  immutable 
perception  of  the  real  threat  or  need. 

3.  Competition  and  Management  Options  .***  Policies  and  prac¬ 
tices  are  outlined  with  the  potential  to  greatly  increase  the 
freedom  of  action  and  the  alternatives  available  to  DOD  at 


For  findings  and  recommendations  in  greater  detail,  see  Sections 
I-B-l  and  I-B-2. 

For  findings  and  recommendat ions  in  greater  detail,  see  Section 

I-B-3. 

For  findings  and  recommendations  in  greater  detail,  see  Sections 
I-B-6,  I-B-7,  r-B-11,  I-B-12 ,  ami  I-tt-14. 
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every  point  throughout  tne  acquisition  and  maintenance  '-yde. 
The  groundwork  must  be  carefully  laid  to  develop  competitive 
production  sources  of  equipment  and  sources  of  maintenance 
services.  For  many  types  of  electronic  equipment,  this  en¬ 
tails  standardizing  interfaces  to  ensure  interchangeability 
of  competing  designs,  preference  for  "what  to  do"  specifica¬ 
tions  over  "how  to  do"  specif ications ,  avoiding  lock-in  to  a 
single  supplier,  allowing  technological  evolution  within  the 
constraints  of  interface  specifications,  and  providing  al¬ 
ternatives  to  the  current  preponderance  of  military  mainte¬ 
nance  and  repair  activity  in  the  many  cases  where  combat  ef¬ 
fectiveness  is  not  really  enhanced  by  military  maintenance. 

4.  Reliability  Enhancement."  The  key  to  reliability  is  simplic¬ 
ity;  purging  requirements  and  specifications  of  questionable 
or  urnecessary  design  demands  will  simultaneously  reduce  ac¬ 
quisition  costs  and  support  requirements.  Quantitative  re¬ 
liability  requirements  can  and  should  be  made  realizable  and 
consistent  with  expected  equipment  complexity  and  should  then 
be  achieved  through  formal  factory  and  field  programs  aimed 
at  reliability  growth.  Transferring  the  maintenance  burden 
to  suppliers  through  the  use  of  long-term  warranties,  where 
feasible,  can  be  expected  to  motivate  supplier  effort  toward 
evolving  increasingly  reliable  and  maintainable  equipment 
designs  and  toward  minimizing  the  sum  of  the  production  and 
support  costs. 

5.  Maintenance  Training."'"  A  reversal  of  current  maintenance 
training  sequences  is  recommended  to  make  earlier  and  more 
efficient  use  of  the  scarce  military  manpower  in  this  era  of 
the  volunteer  force.  This  entails  teaching  green  maintenance 


For  findings  and  re< ommendations  in  greater  detail,  see  Sections 
I-B-5,  I-B-9,  and  1-8-11. 


For  findings  and  recommendations  in  greater  detail,  see  Sr  tion 
i-B-in. 


personnel  to  do  useful  work  by  making  use  of  job  performance 
aids  (JPAs)  before  leading  them  into  engineering  fundamentals. 
The  approach  is  expected  to  make  new  maintenance  personnel 
more  productive  during  their  initial  enlistments. 

Individual  findings  and  recommendations  are  presented  in  more  de¬ 
tail  in  Section  I-B  following.  More  extended  analysis,  discussion, 
and  backup  can  be  found  in  the  complete  report. 

The  term  "electronics"  covers  a  broad  array  of  devices,  equip¬ 
ment,  subsystems  and  systems.  Therefore,  we  have  attempted  to  indi¬ 
cate  in  the  ensuing  recommendations,  where  possible,  the  specific 
classes  of  electronics  to  which  they  evidently  apply.  This  gives  rise 
to  the  risk  that  certain  concepts  that  we  believe  to  be  important  may 
be  interpreted  too  narrowly.  Specifically: 

-  The  theme  of  encouraging  and  sustaining  both  design  and  price 
competition  through  production,  we  assert,  applies  to  many 
large  systems  as  well  as  to  small  equipments  and  should  be 
considered  as  a  possibility  in  every  case,  although  for  large 
systems  specific  analyses  of  alternatives  will  be  required  to 
arrive  at  the  best  course  of  action. 

-  The  theme  of  substituting  unit  replacement  for  unit  repair  at 
organizational  maintenance  levels  and  getting  factory  repair 
through  long-term  supplier  warranties  as  an  alternative  to 
military  repair,  we  suggest,  has  applicability  wherever  the 
transportation  facilities  will  permit,  and  the  U.S.  military 
is  generally  well  supported  with  t i ansportation .  In  any 
event,  electronic  unit  replacement  will  not  impose  a  signifi¬ 
cantly  greater  overall  burden  on  transportation  than  will 
field  repair.  Furthermore,  analysis  on  a  military-mission 
basis  can  be  used  to  determine  appropriate  tradeoffs  in  place 
of  the  past  a  priori  assumption  that  in  most  cases  field  re¬ 
pair  is  both  necessary  and  desirable. 

-  The  oncept  of  encouraging  evolution  of  internal  design  and 
modif ications  to  enhance  reliability  within  the  const raints 


of  interface  standards ,  we  well  realize ,  opposes  the  conven¬ 
tional  wisdom  that  spares  stocking  and  military  repair  will 
become  burdensome  if  internal  configurations  are  not  firmly 
fixed,  but  we  believe  that  exaggerated  concern  with  internal 
configuration  control  before  achieving  reliability  objectives 
has  in  a  good  many  cases  exacerbated  rather  than  relieved  the 
maintenance  burden.  However,  rigorous  configuration  control 
at  standardized  interfaces  is  clearly  essential. 

B.  FINDINGS  AND  RECOMMENDATIONS 

1.  Cost  Data  Collection  and  Reporting  Systems 

Finding: 

Throughout  the  Electronics-X  Study,  we  have  encountered  a  pro¬ 
found  lack  of  valid  cost  data  and  overwhelming  inadequacies  in  che 
pertinent  reporting  systems.  More  specifically: 

•  DOD  appears  to  have  no  cost  accounting  system  capable  of 
providing  data  on  the  full  life-cycle  costs  of  any  elec¬ 
tronic  subsystem.  Full  life-cycle  costs  include  RDT&E, 
Procurement,  O&M,  Military  Personnel  costs,  other  direct 
costs,  allocable  indirect  costs,  and  depreciation  or  other 
measure  of  capital  investment  in  support  equipment  and 
facilities.  Maintenance  costs  and  indirect  costs,  in  par¬ 
ticular,  are  very  inadequately  known  from  a  cost  accounting 
point  of  view.  Moreover,  there  is  often  confusion  as  to  the 
significance  of  the  various  reported  costs  because  o(  in¬ 
adequate  or  nonuniform  definition  ot  cost  elements.  As  a 
result,  cost  estimation  and  cost-ef t eetiveness  tradeoffs 
are  difficult  at  best  and  often  impossible.^ 

Recommendations: 

•iHrir  A  systematic  effort  should  be  undertaken  to  develop  a  step¬ 
wise  implementation  of  a  complete1  and  unitorm  cost  a  count¬ 
ing  system  throughout  DOD,  with  emphasis  on  valid  input 

Highest  priority;  ★★  high  priority;  ★  priority. 
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data.  This  system  must  be  compatible  with  the  cost  account¬ 
ing  system  for  DOD  contractors  that  is  evolving  under  the 
aegis  of  the  Cost  Accounting  Standards  Board.  It  must  al¬ 
low  meaningful  comparison  between  Service  in-house  costs  and 
contractor  costs  on  individual  systems,  subsystems,  and 
equipments.  As  a  first  step,  a  marginal  cost  system  using 
sampling  techniques  for  support -cost  inputs  should  be  imple¬ 
mented.  The  system  must  then  evolve  to  cover  full  costs  of 
both  acquisition  and  support. 

A  central  organization  within  OSD  should  be  designated  to 
organize  this  cost  information  system  and  to  coordinate  the 
efforts  of  responsible  Service  elements. 

★  To  test  and  exercise  the  system,  each  Service  major  procure¬ 
ment  command  should  designate  certain  electronic  systems  for 
review  of  cost  reporting  requirements.  Appropriate  steps 
should  be  taken  to  ensure  consistency  among  the  report  out¬ 
puts,  complete  record  retrieval,  and  periodic  validation  of 
the  reported  costs.  These  records  should  be  centrally  lo¬ 
cated  and  should  be  made  available  to  the  cost  analysis 
community. 

2.  Reliability  Data  Collection  and  Reporting  Systems 

Findings; 

•  There  is  no  routine  field-reliability  reporting  system  in 
DOD  that  can  provide  meaningful  feedback  to  producer  com¬ 
mands  and  to  manufacturers  on  the  field  reliability  of 
electronic  subsystems.  Existing  maintenance  data  collec¬ 
tion  systems  were  not  originally  designed  for  reporting 
reliability  data,  and  they  do  not  perform  this  function 
adequately.  Moreover,  there  is  considerable  confusion  in 
the  terms  used  to  describe  reliability.  They  are  first 
used  in  specifications  in  one  context  and  are  then  employed 


Highest  priority;  ★★  high  priority;  ★  priority. 


in  field  reports  in  another  context.  The  field-use  environ¬ 
ment  and  the  field-maintenance  environment  arc  not  adequately 
quantified  in  field  reports  to  ensure  consistent  interpre¬ 
tation  of  field  data.  Thus,  field  information  is  ambiguous 
at  best.  This  poses  a  difficulty  in  predicting  and  specify¬ 
ing  reliability  and  in  comparing  the  attained  field  relia- 

4 

bility  with  the  specification. 

•  There  exists  one  reliability  data  collection  system  that  ap¬ 
pears  to  be  working  effectively:  TAMMS-SDC,  a  data-sampling 
system  used  by  the  Army.  It  utilizes  technically  trained, 
experienced  field  service  personnel  to  sample  reliability 
data  and  certain  other  information  according  to  individu¬ 
alized  sampling  plans.  It  thus  provides  a  possible  model 

for  the  rapid,  cost-effective  implementation  of  a  data  col- 
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lection  system  for  selected  equipments.  * 

Recommendations : 

In  each  major  producer  command  (AMC,  NMC ,  AFSC,  AFLC) ,  es¬ 
tablish  (or  broaden)  a  system  for  competent  technical  re¬ 
porting  of  reliability,  availability,  and  maintainability 
(RAM)  and  marginal  cost  feedback  information  from  the  field 
on  selected  systems  and  equipments,  using  sampling  methods. 
Identify  in  each  such  command  a  data-sampling  planning  or¬ 
ganization  to  plan  and  outline  in  detail  the  sampled  infor¬ 
mation  to  be  collected  and  the  sampling  nethods  to  be  used, 
and  designate  a  suitable  data-processing  activity  to  process 
and  distribute  the  outputs  of  the  data-sampling  system. 

Prime  candidates  for  sample  data  collection  are: 

-  Newly  deployed  systems  during  the  first  year  of  operation 
Systems/ subsystems  deployed  in  large  quantity 
Subsystems/equipments  critical  for  the  operation  of 
major  systems  or  being  procured  as  GFE  for  major  systems. 

★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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**  Organize  a  RAM  Data  Systems  Task  Force,  representing  the 
several  Services  and  chaired  by  OSD,  to  study  and  compare 
the  relative  cost-effectiveness  of  a  routine  maintenance 
data  collection  system  (such  as  3M  or  AFM  66-1)  with  a 
sampled-data  collection  system  (such  as  TAMMS-SDC).  Con¬ 
sider  and  recommend  the  advisability  of  possible  courses 
of  action  such  as  the  following: 

1.  Discontinue  routine  processing  of  TAMMS -Aviation,  3M, 
and  AFM-66-1  RAM  data  at  the  national  level.  Replace 
these  systems  by  sampled-data  collection  systems. 

2.  Continue  processing  at  the  national  level  all  safety- 
related  RAM  information,  such  as  3M-Aviation,  AFM  66-1, 
and  TAMMS-Aviation.  Supplement  these  systems  by  periodic 
sampling  studies  to  check  and  improve  the  information 
collected  by  the  maintenance  data  collection  systems. 

3.  Extend  the  maintenance  data  collection  systems  to  the 
depot  level  in  selected  cases  and  ensure  that  all  cost 
information  and  RAM  information  is  compatible  in  format 
(Single -Thread  Data  System)  so  that  it  can  be  aggregated 
by  system. 

★  Establish  a  new  RAM  Information  Exchange  Program  at  the 
electronic  equipment  level  in  a  form  patterned’  after  the 
Government-Industry  Data  Exchange  Program  (GIDEP).  It 
should 

-  Provide  automatic  interchange  of  RAM  data  related  to 
parts,  components,  equipments,  subsystems,  and  systems 
utilized  by  the  Services. 

-  Have  participants  from  Army,  Navy,  Air  Force,  NASA, 
Canadian  Military  Electronics  Standards  Agency  (CAMESA), 
and  numerous  contractors. 

-  Be  chartered  by  Joint  Logistics  Commanders. 

★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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Provide  a  forum  for  an  organized  direct  exchange  of  this 
information  with  other  Services  and  with  all  interested 
contractors . 

3 .  Requirements  and  Acquisition  Decisions 
Findings: 

•  A  requirement  for  a  system  or  subsystem  may  be  defined  as 
including  performance,  physical  characteristics,  cost, 
quantity,  and  schedule — all  in  conformity  with  a  statement 
of  threat  or  need.  While  the  overall  requirements  and  ac¬ 
quisition  decision  process  includes  attention  to  all  these 
components,  the  current  approach  to  establishing  a  require¬ 
ment  tends  to  start  with  desired  performance  and  character¬ 
istics.  Cost,  quantity,  and  schedule  are  modifiers,  added 
later.  Thus,  requirements  tend  to  be  performance -driven, 
with  inadequate  early  consideration  of  pragmatic  essentials.6 

•  The  requirements  and  acquisition  decision  process  includes, 
at  least  formally,  the  attributes  necessary  f  >r  effective 
management  of  system  acquisition.  In  actual  implementation, 
however,  cost-driving  aberrations  of  the  process  occur  at 
several  stages:  in  establishing  the  original  requirement 
and  in  expanding  it  into  system  characteristics  and  specifi¬ 
cations;  in  the  interactions  between  management  practices 
and  advanced  technology;  in  cost  estimating;  and  in  con¬ 
tracting  practices.6 

•  Costs  of  progressions  of  wholly  new-gene ration  weapons  sys¬ 
tems  have  increased  much  faster  than  costs  of  progressions 
of  product -improved  systems,  even  when  the  product  improve¬ 
ments  have  involved  incorporation  of  new  generations  of 
electronic  subsystems.  This  suggests  that  cost  savings 
would  result  if,  in  establishing  requirements,  within- 
generation  system  improvements  were  favored  over  totally, 
new-generation  developments,  where  that  is  feasible  within 
the  uncertainties  of  threat  or  need.  The  additional  costs 
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of  new- generation  systems  appear  to  arise  partly  from  trying 
to  drive  new  vehicle,  engine,  and  electronics  developments 
all  to  the  same  schedule ,  and  partly  from  the  engineering 
difficulties  in  achieving  compatibility  among  all  three  when 
none  of  them  is  yet  defined  well  enough  to  permit  prediction 
of  the  interactions  vhen  they  are  combined.  This  suggests 
that  cost  savings  could  be  achieved  if  electronics  IOCs  were 
established  separately  and  independently  of  vehicle  IOCs, 
when  feasible,  and  the  electronic  subsystems  were  independ¬ 
ently  developed.  The  specification  of  form,  fit  (interface), 
and  function  requirements  for  the  electronics  is  essential 
to  such  independent  development.  Independent  development 
would  make  possible  the  consolidation  of  requirements  for 
like  electronic  subsystems  and  equipment  and  would  broaden 
the  applicability  of  specific  designs  to  several  systems. ^ 

•  Other  important  aberrations  of  the  requirements  process  lead¬ 
ing  to  cost  growth  include:  selection  of  desired  operating 
points  too  high  on  the  cost- performance  curve;  failure  to 
allow  for  uncertainty  in  selecting  the  operating  point;  cas¬ 
cading  of  detailed  requirements  between  the  decision  and 
detailed  implementation  levels;  and  failure  to  iterate  re¬ 
quirements  decisions  as  development  experience  is  gained.^ 

•  There  is  insufficient  visibility,  at  top  management  levels, 
of  potentially  cost-driving  electronic  subsystem  problems.^ 

Recommendations: 

•kirk  In  explor-i na  and  establishing  a  system  requirement,  give 
performance,  physical  characteristics,  cost,  quantity,  and 
schedule  equal  status  from  the  beginning,  and  perform  trade¬ 
offs  among  these  early  in  the  game. 

★★★  In  major  system  developments,  separate  vehicle  IOCs  and 
electronic  subsystem  IOCs  where  possible,  and  develop  the 


kkk  Highest  priority;  kk  high  priority;  ★  priority. 
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electronics  independently.  Consolidate  like  subsystem  or 
equipment  requirements  wherever  feasible. 

Increase  visibility  to  top-level  management  of  potentially 
cost-driving  developments  of  electronic  subsystems  associ¬ 
ated  with  major  systems  by  instituting  suitable  review  prior 
to  each  DSARC  review.  As  appropriate,  provide  for  a  similar 
visibility  to  management  of  developments  of  less-than -major 
electronic  subsystems  and  equipments  by  refocusing  reviews 
to  make  them  analogous  to  DSARC  reviews,  but  at  lower  man¬ 
agement  levels. 

irk*  Give  increased  consideration  to  product- improvement  pro¬ 
grams  as  a  means  of  fulfilling  new  requirements,  as  opposed 
to  institution  of  wholly  new  development  programs. 

•kirk  Select  technology  and  performance  objectives  for  new  develop¬ 
ments  conservatively  (i.e.  ,  low  on  the  cost- performance 
curve),  except  in  cases  where  military  necessity  imposes  an 
overriding  need  for  risk-taking  to  achieve  extremes  of  per¬ 
formance.  Allow  for  uncertainty  in  establishing  the  corre¬ 
sponding  system  requirements. 

•kirk  Iterate  requirement  and  acquisition  decisions  if  performance, 
characteristics,  cost,  quantity,  or  schedule  departs  sig¬ 
nificantly  from  initial  plans  during  development.  Establish 
criteria  to  trigger  such  iteration. 

4.  Design  to  Cost 

Findings; 

•  Design  to  cost  (DTC)  in  defense  systems  acquisition  is  still 
in  its  infancy.  Among  the  problems  yet  to  be  solved  are; 

-  How  to  establish  the  cost  target  in  view  of  the  lack  of 
an  adequate  data  base  and  limited  cost-estimating  tech¬ 
niques. 

Highest  priority;  kk  high  priority;  ★  priority. 
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How  to  resolve  the  uncertainty  for  the  user  resulting 
from  continual  cost- performance  tradeoffs  and  their 
potential  effects  on  force  size,  capability,  and  logistics. 

-  How  to  incorporate  commercial  cost-saving  practices  in 
DOD  DTC  procedures  when  motivations  and  accountability 
are  basically  different  in  the  two  sectors. 

-  And  how  to  extend  competition  through  the  acquisition 
cycle,  especially  for  acquisition  of  large-scale  systems 
and  for  large-scale  procurements.7 

•  Institutional  factors,  established  ways  of  doing  business, 
and  organizational  inertia  still  lead  to  DTC  procurement 
practices  not  consistent  with  the  DTC  philosophy,  such  as: 
provisions  for  separate  evaluations  of  the  cost  and  the 
technical  aspects  of  the  proposals,  thus  precluding  the 
requisite  tradeoffs;7  requirements  for  too  early  and  too 
detailed  configuration  control  that  will  interfere  with 

g 

evolutionary  improvements;  inflexible  application  of  re¬ 
strictive  specifications  on  materials,  parts,  processes, 

.  9  .  .  7 

and  finishes;  and  various  other  restrictive  provisions. 

•  DTC  developments  may  be  more  expensive  than  traditional  de¬ 
velopments  in  which  production  cost  is  not  invoked  as  a  de- 

10 

sign  parameter. 

•  Wholehearted  implementation  of  DTC  in  military  electronics 
implies: 

-  Greater  reliance  on  proven  technology,  with  technological 
advance  driven  largely  by  the  commercial  sector  in  areas 
of  broad  commercial  usage. 

-  Changed  logistics  procedures,  including  more  detailed 
analyses  and  regular  consideration  of  the  alternatives 

of  contractor  maintenance  or  of  "zero  maintenance"  (i.e., 
throwaway  parts  or  components ) . 
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-  Use  of  interface  standardization  and  the  resultant  evolu¬ 
tion  of  several  competing  interchangeable  designs,  with 
consequently  increased  logistic  complexity.  Such  added 
logistic  complexity  can  be  more  tolerable  if  the  afore¬ 
mentioned  changes  in  maintenance  concepts  are  imple¬ 
mented  . 7 

•  The  experimental  and  other  major-system  DTC  acquisitions 
initiated  in  1972  will  not  be  complete  in  time  to  provide 
DOD  the  experience  needed  for  other  acquisition  programs  in 
the  near  future.  DOD  will  therefore  probably  have  to  at¬ 
tempt  to  act  on  "lessons  learned"  before  the  "experiment" 
is  completed. 

•  The  flSPR  includes  no  barriers  to  DTC,  but  some  associated 
contract  implementation  practices  of  long  standing  must  be 
changed  to  obtain  the  full  flexibility  that  DTC  requires. 

Recommendations : 

★★★  Choose  easily  defined  DTC  cost  targets  such  as  unit  produc¬ 
tion  or  flyaway  costs  (rather  than,  for  example,  the  pres¬ 
ently  still  ill -defined  life-cycle  costs;  but  see  next 
paragraph).  Establish  s  ich  targets  early,  permitting  suc¬ 
cessive  revisions  durinc  development,  contractual  commitment 
to  a  unit  cost  for  low-rate  initial  production  (LRIP)  at  the 
start  of  LRIP,  and  another  contractual  commitment  for  unit 
cost  at  the  start  of  full-scale  production  for  systems  to 
be  procured  in  quantity.  Flexibility  to  revise  cost  tarqets 
should  decrease  and  should  be  based  increasingly  on  firm 
experience  as  the  development-to-producticn  cycle  progresses. 

II  the  equipment  is  to  be  maintained  by  the  supplier 
under • long-term  warranty,  the  DTC  target  can  be  established 
as  the  sum  of  the  production  cost  anti  total  warranty  cost; 
this  sum  may  be  considered  a  surrogate  tor  life-cycle  cost. 

irHr  Highest  priority;  ★★  high  priority;  ★  priority. 
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But  if  military  maintenance  is  contemplated,  establishing 
life-cycle  cost  as  a  DTC  target  is  not  now  appropriate  be¬ 
cause  of  the  inadequacy  of  current  knowledge  of  the  cost  to 
the  Government  of  military  maintenance,  and  of  the  dependence 
of  these  costs  on  equipment  parameters. 

iririr  Establish  explicit  limits  of  deviation  from  "desired"  per¬ 
formance/characteristics/cost/schedule/quantity  requirements . 
and  authorize  program  managers  to  trade  off  freely  among 
these  separate  requirement  parameters  within  the  established 
limits.  Establish  "desired"  parameters  and  permissible  devi¬ 
ations  such  that  tradeoffs  ai'e  in  fact  possible  and  not  sub¬ 
ject  to  hidden  constraints  due  to  technical  feasibility, 
absolute  force  requirements,  or  available  budgets. 

•kirk  To  the  extent  feasible,  maintain  design  and  price  competi¬ 
tion  throughout  the  acquisition  process,  especially  for 
components  and  subsystems. 

★★★  In  the  contractor  selection  process,  ensure  that  performance 
and  cost  are  considered  together  rather  tha  .  evaluated 
separately. 

★★  This  study  identified  only  one  DTC  acquisition,  namely,  the 
Navy  electronic  warfare  suite,  that  uses  the  approach  of 
specifying  equipment  needs  and  requirements  functionally, 
leaving  it  to  the  competing  contractors  to  propose  optimal 
development  and  production  strategies  to  maximize  payoff  to 
both  the  Government  and  the  contractors,  and  including 
maintenance  strategies  among  the  variables.  More  experi¬ 
mentation  with  this  approach  should  be  undertaken. 

★  Increase  the  number  of  DTC  acquisitions  of  electronic  sub¬ 
systems  designated  as  "experimental"  for  observation  and  ex¬ 
traction  of  "lessons  learned."  Include  in  these  observa¬ 
tions  the  electronic  subsystems  of  the  17  major  systems 
designated  as  "design  to  cost"  in  early  1973.'''^  In  further 

kkk  Highest  priority;  high  priority;  ★  priority. 
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experimental  DTC  acquisitions,  seek  wider  variation  of  the 
management  variables  relevant  to  DTC  (for  example,  tradeoffs 
among  requirements,  program  manager's  freedom  to  trade  off, 
competition  throughout  the  acquisition  cycle,  and  different 
types  of  contract).  The  Services  should  publish  "lessons 
learned"  periodically  to  maximize  the  pool  of  explicitly 
analyzed  experience  available  to  all. 

Review  the  contracting  procedures  associated  with  DTC  con¬ 
tracts,  modify  those  that  inhibit  requisite  DTC  flexibility, 
and  incorporate  the  modifications  in  the  ASPR,  if  necessary. 

5 .  Design  for  Improved  Reliability 

Findings; 

•  The  essence  of  reliability  is  simplicity.  Empirical  evidence 
indicates  clearly  that  most  equipments  of  high  unit  produc¬ 
tion  cost  or  high  complexity  have  lower  MTBF  than  equipments 

12 

of  lower  unit  production  cost  or  lower  complexity. 

•  The  reliability  of  electronic  components  is  improving  rap¬ 
idly,  and  design  revisions  to  incorporate  modern  technology 
at  the  appropriate  stage  of  maturity  can  substantially  im¬ 
prove  electronic  equipment  reliability  without  detriment  to 
performance.  However,  premature  or  inappropriate  applica¬ 
tion  of  new  technology  leads  to  reduced  utility. 

•  Few  military  development  programs  are  aimed  at  increasing 
reliability  through  simplification  or  technological  up¬ 
grading  while  holding  performance  constant.13 

•  Attainable  reliability  can  be  crudely  predicted  on  the  basis 
of  equipment  complexity  or  unit  production  cost.  Relia¬ 
bility  requirements  in  specifications,  however,  are  not 

based  on  such  predictions  and  thus  are  frequently  impossibly 

12  13 

high  or  needlessly  low.  * 


★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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•  System  partitioning  into  LRUs  or  WRAs  can  be  devised  in  a 
way  that  minimizes  support  costs,  if  this  aspect  of  system 
design  is  considered  simultaneously  with  planned  provision¬ 
ing  and  maintenance  practices. 

•  The  growth  of  measured  reliability  is  often  sluggish  in  the 
factory.  After  the  equipment  is  received  by  the  Services, 
the  field  reliability  often  never  achieves  growth;  rather, 
it  declines.  Formal  reliability  monitoring  and  management 
can  speed  reliability  growth  both  in  the  factory  and  in  the 
field  and  make  the  ultimate  cost  and  outcome  predictable.13 

•  Motivating  a  contractor  to  design  for  minimum  life-cycle 
cost  is  an  important  potential  stimulant  to  reliability  im¬ 
provement.  One  approach  is  to  make  the  contractor  respon¬ 
sible  for  maintenance  as  well  as  production  costs  through 
the  application  of  long-term  warranties.  But  complete 
transfer  of  an  unlimited  maintenance  risk  to  the  contractor 
may  be  impractical,  as  may  be  seen  by  analogy  to  the  fail¬ 
ures  of  the  total-package  procurement  process.  It  is  neces¬ 
sary  to  devise  new  ways--possibly  new  types  of  warranties-- 

13  14 

to  accomplish  this  in  a  pragmatically  acceptable  manner. 
Recommendations: 

★★★  Limit  the  complexity  of  new  subsystem  or  equipment  designs 
(as  measured  by  criteria  such  as  unit  production  cost  or 
parts  count)  to  a  level  consistent  with  the  reliability  re¬ 
quired  by  a  mission  analysis.  Require  evidence  of  compli¬ 
ance  as  a  preliminary  to  DSARC  review  for  electronic  sub¬ 
systems  of  major  systems,  and  as  a  preliminary  to  sub-DSARC 
review  for  independently  developed  electronic  subsystems. 

+++  Require  contractually  the  in-plant  use  of  a  formal  manage¬ 
ment  methodology,  such  as  methods  using  Duane-curve  monitor¬ 
ing,13  to  ensure  reliability  growth  in  electronic  equipments 

Irk*  Highest  priority;  ★★  high  priority;  ★  priority. 
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and  systems.  For  field- reliability  enhancement,  a  formal 
reliability-growth  management  technique  should  be  applied 
(by  Service  management  action  or  contractual  requirement)  to 
selected  equipments  on  an  experimental  basis. 

Use  long-term  contractor  maintenance  warranties  to  motivate 
the  contractor  to  design  for  minimum  life -cycle  cost.  [See 
the  later  recommendations  on  warranties  (Section  I-B-ll)  for 
further  details.] 

Specify  the  reliability  of  electronic  equipments  or  systems 
to  be  consistent  with  predictions  based  on  their  anticipated 
complexity  (or  unit  production  cost,  as  a  surrogate  for 
complexity) . 

Undertake  redesign  of  selected  equipments  with  the  specific 
objective  of  improving  reliability  while  holding  performance 
constant.  The  selection  of  equipments  to  be  redesigned 
should  be  based  on  expected  future  utility  and  an  observed 
reliability  substantially  lower  than  that  predictably  real¬ 
izable  by  using  up-to-date,  proven  technology. 

6.  Design  to  Facilitate  Competition 

Findings: 

•  Competition  is  a  missing  .ingredient  in  about  two-thirds  of 
military  prime  contract  awards.  Even  when  a  program  does 
admit  development  competition,  there  is  a  strong  tendency 
for  the  Government  to  become  locked  into  a  single  supplier 
in  subsequent  production.  The  loss  of  Government  freedom 
of  action  permits  suppliers  to  force  prices  up  by  various 
devices.  The  use  of  large-scale,  multiyear  buys  exacerbates 
the  risks  to  both  the  Government  and  its  suppliers,  as  well 
as  inducing  design  stagnation  in  the  equipment  procured. 


Highest  priority;  high  priority;  ★  priority. 
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•  Competition  among  similar  equipments  designed  by  different 

suppliers  and  the  upgrading  of  the  electronics  complement 

of  weapons  systems  are  both  now  severely  inhibited  by  the 

lack  or  interchangeability  among  like  equipments  and  the 

consequent  high  cost  and  enormous  inconvenience  of  modify- 

9  16 

ing  installations  to  accommodate  substitutions.  ’ 

•  In  commercial  airline  electronics  and  elsewhere  in  the  ci¬ 
vilian  economy,  interface  standardization  and  continuing  de¬ 
sign  and  price  competition  are  used  to  hold.priees  down, 
maintain  alternative  sources  of  supply,  encourage  design  im¬ 
provement  ,  and  allow  for  interchangeability  among  successive 
generations  of  electronic  subsystems.  Periodic  buys  spaced 

over  the  procurement  period  minimize  the  impact  of  buyer  or 

,.  .  ,  16,17 

supplier  error  m  any  one  contract. 

Recommendations: 

Lay  the  groundwork  for  future  design  and  price  competition 
through  production  and  for  ready  replacement  of  old  designs 
by  new-gene ration  equipment  by  ensuring  the  interchangea¬ 
bility  of  similar  equipments  intended  for  similar  applica¬ 
tions.  Accomplish  this  by  including  (or  by  requiring  prime 
contractors  to  include)  mechanical,  electrical,  and  environ¬ 
mental  interface  standards  for  each  unit  as  a  part  of  mili¬ 
tary  electronic  equipment  specifications. 

Require  design  interchangeability  when  production  com¬ 
petition  or  design  upgrading  is  foreseen  as  desirable  or 
likely.  Equipment  classes  that,  by  virtue  of  large  dollar 
volume  or  rapid  technological  growth,  are  judged  ripe  for 
initial  application  of  interface  standardization  are:  air¬ 
borne  communication,  navigation,  identification  and  weather 
radar  equipments;  vehicular  communication  equipments;  and 
modular  electronics  packages  for  tactical  missiles. 

★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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Modify  approval  processes  for  engineering-change  pr  ^osals 
to  expedite  incorporation  by  suppliers  of  internal  design 
improvements  to  enhance  reliability  and  performance  or  in¬ 
clusion  of  new  technology  to  meet  competition  during  the 
procurement  cycle  and  even  after  deployment,  if  the  suppliers 
are  called  upon  to  maintain  their  equipment.  But  keep  rigid 
control  over  interface  configurations  to  ensure  interchange  - 
ability. 

iHrtr  Obtain  multiple  developments  of  equipments  conforming  to 
interface  specifications.  Where  the  potential  market  for 
the  equipment  is  large  enough,  encourage  industry-financed 
development;  otherwise,  procure  multiple  developments  under 
Government  contracts. 

★★★  Facilitate  Government  testing  and  qualif ication  of  designs 
offered  in  compliance  with  the  specifications,  whether  or 
not  the  designs  were  developed  under  Government  contract. 
Plan,  prepare,  and  provide  for  retesting  and  ^qualification 
of  modified  designs  submitted  in  production  competitions 
subsequent  to  the  initial  competition. 

★★★  To  overcome  the  potential  problem  of  spare-parts  stocking 
and  field  repair  of  multiple  equipment  configurations,  make 
use  of  depot  repair  or  supplier  maintenance  under  warranty. 

In  the  field,  replace  rather  than  repair  failed  replaceable 
units  of  equipment.  Include  warranty  requirements  when 
initiating  development. 

To  achieve  multiple -source  availability,  rely  on  performance 
specifications  plus  environmental  and  interface  requirements 
(i.e.,  "form,  fit,  function"  specifications)  to  define 
equipment,  rather  than  imposing  detailed  specifications  on 
parts,  processes,  materials,  and  internal  conf iguration . 


Highest  priority;  **  high  priority;  ★  priority. 
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•  To  broaden  the  markets  for  competitive  suppliers,  encourage 
the  evolution  of  multi-Service  interface  standards. 

7 .  Production 

The  following  broadly  stated  findings  and  recommendations  apply 
in  such  a  surprisingly  large  variety  of  situations  that  we  have  chosen 
to  state  them  without  detailed  recitation  of  numerous  and  important 
exceptions  in  order  that  their  potential  applicability  be  studied  in 
every  case.  Yet  their  validity  clearly  varies,  depending  on  the  class 
of  electronics  involved.  In  general  terms,  they  are  rarely  valid  for 
the  one-of-a-kind,  not-too-high-priced  item.  They  are  almost  always 
true  for  large-number,  high-dollar  production  contracts.  In  between, 
their  validity  varies,  and  the  applicability  of  these  recommendations 
should  be  studied  carefully,  not  dismissed  a  priori.  An  important 
consideration,  for  example,  is  unit  development  cost  versus  unit  pro¬ 
duction  cost.  Another  is  the  required  degree  of  integration  of  the 
subsystem  with  the  overall  system. 

Findings: 

•  Production-price  competition  generally  reduces  the  cost  of 

military  electronics.  The  cost  reductions  resulting  from 

competition  often  substantially  exceed  those  realizable  by 

extending  the  price-quantity  projections  ("learning  curves") 

18 

of  the  original  suppliers. 

•  Aggregating  requirements  into  a  single,  large,  multiyear 
procurement  not  only  precludes  the  cost  leductions  obtain¬ 
able  from  competition  but  also  makes  the  Government  vulner¬ 
able  to  upward  price  pressures  by  the  selected  supplier  and 
induces  design  stagnation.1^ 

•  The  potential  benefit  of  competition  in  reducing  production 
costs  is  larger  in  high-dollar-value  items  and  large  con¬ 
tracts  than  in  smaller  ones,  but  is  seldom  pursued  because 


•klrir  Highest  priority;  ★★  high  priority;  ★  priority. 


of  inhibitions  against  incurring  the  additional  front-end 
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costs  associated  with  establishing  a  second  source.  ’ 

•  Production  competition  may  be  expected  to  cut  a  substantial 
amount,  such  as  20  percent,  from  total  production  costs. 

The  potential  savings  are  often  more  than  adequate  to  com¬ 
pletely  finance  a  competitive  development,  depending  on  the 
ratio  of  development  costs  to  production  costs  and  on  the 
period  over  which  planned  procurements  are  to  take  place. 
That  period  is  often  determined  by  factors  such  as  budget 
limits  and  the  need  for  maintaining  the  defense  industrial 
base  rather  than  by  optimum  production  scheduling;  however, 
the  high  cost  of  accomplishing  these  other  objectives  should 
be  reconsidered.  ’ 

•  Where  feasible,  carrying  on  design  competition  as  well  as 
price  competition  through  production  will  encourage  a  suc¬ 
cession  of  technological  improvements  to  the  product  that 
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will  mitigate  the  pressures  for  drastic  design  changes.  * 

•  Sustaining  design  competition  through  production  requires 
Government  procurement  strategies  that  differ  from  those  of 
the  traditional  competition  for  production  of  a  single  se¬ 
lected  design.  Losers  of  an  initial  competition  must  be 
offered  inducements  to  continue  upgrading  their  designs, 
and  potential  new  competitors  must  be  offered  inducements 
to  develop  competing  designs.  The  development  effort  re¬ 
quired  may  impose  substantial  financial  risks  on  the  devel¬ 
opers.  To  encourage  the  taking  of  such  risks,  the  Govern¬ 
ment  must  be  able  to  provide  credible  assurance  that  such 
risk-taking  has  reasonable  expectation  of  realizing  rewards 
by  winning  future  competitions.  A  concerted  effort  should 
be  made  to  identify  systems,  subsystems,  and  components  to 
which  this  approach  is  applicable.^’17’^ 


Recommendations : 


irk*  Where  the  quantity  to  be  bought  is  large  enough,  depart 

from  the  conventional  approach  of  aggregating  procurements 
into  a  single  large  buy  intended  to  take  advantage  of 
"learning  curves."  Instead,  fragment  the  procurements  into 
sequential  buys,  inviting  design  and  price  competition  on 
each  buy  by  the  several  suppliers  of  qualified  interchange¬ 
able  equipments. 

The  Government  must  assure  prospective  suppliers  that  there 
will  be  future  design  and  price  competition.  One  method  of 
so  doing  is  to  analyze  and  publish  future  needs  and  a 
schedule  of  planned  competitive  buys. 

The  Government  must  provide  assurance  that  new  or  improved 
designs  will  be  given  full  consideration  in  future  competi¬ 
tions  if  they  meet  the  form,  fit,  and  function  requirements 
that  ensure  interchangeability  with  prior  designs.  This 
implies  the  need  for  inclusion  of  interface  requirements  in 
Government  specifications. 

The  Government  must  offer  to  perform  and  must  be  prepared  to 
perform  laboratory  tests  and  evaluations  of  the  actual  hard¬ 
ware  prototypes  offered  by  bidders  or  prospective  competitors 
in  order  to  qualify  the  designs  fo^  current  and  future  com¬ 
petition. 

★  When  it  is  desirable  and  necessary  to  sustain  competition, 
award  fractions  of  each  buy  to  two  oi  three  competitors  in 
proportion  to  the  merit  of  their  respective  designs  and 
prices,  rather  than  making  the  award  on  a  winner-take-all 
basis . 


Highest  priority;  ★★  high  priority;  ★  priority. 
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8 .  Reprocurement 
Finding: 


•  Whore  a  single  design  must  he  pro  tired  and  later  repro<  urod, 
experience  has  shown  that  dependence  upon  repro' ur< merit  data 
packages  to  enable  a  second  source  to  reproduce  the  design 
has  often  resulted  in  failure  because  the  original  repro- 
curemenc  data  package  cannot  convey  all  the  information  re¬ 
quired  for  successful  proriu  tion  of  the  design.  On  the 
other  hand,  there  is  abundant  ommerrial  experion  e  with 
successful  licensing  and  second-sour  ing,  whi'  h  o  curs  when 
the  original  vendor  believes  that  having  an  effective  se' one 
source  is  essential  to  his  own  profitability.  In  su  h  ases, 

the  vendor  conveys  the  information  not  just  via  a  data 
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package  but  also  via  actual  people-to-peoplo  orita<  t. 


Recommendation: 

**  In  selected  development  one r acts  where  subsequent  competi¬ 


tive  reprocurement  is  anticipated,  the  Government  should 
provide  a  payment  to  the  developer  for  each  accepted  unit 
produced  under  Government  •  ontract  from  the  developer's  de¬ 
sign  by  a  supplier  other  than  the  developer.  This  payment 
should  constitute  a  deferred  part  of  the  compensation  for 
the  reprocurement  data  package.  Such  a  contracting  pro  e- 
dure  should  be  used  by  the  Government  on  a  trial  basis. 


9.  Maintenance 
Finding: 

•  Annual  DOD  e<penditures  for  electronics  maintenance  are  es¬ 


timated  to  approximate  those  for  production  procurement 
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(more  than  $‘>  billion).- 

•  As  indicated  in  prior  findings,  electronics  maintenan  ost 
visibility  is  needed  trefore  management  action  to  rod  i  e  ost 


High*  st  priority;  irtt  high  priority;  *  priority 
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can  be  maximally  effective.  DOD  cost  reporting  systems  do 
not  now  provide  this  visibility. 

•  While  there  is  competition  in  the  procurement  process,  com¬ 
petition  among  maintenance  sources  is  rarely  used  as  an  in¬ 
ducement  co  reducing  costs.  Only  a  small  fraction  (about 

8  percent)  of  the  maintenance  effort  is  contracted,  while 

more  than  SO  percent  is  performed  by  military  maintenance 
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personnel  and  activities. 

•  The  DOD  policy  guideline  that  at  least  30  percent  of  mission- 
essential  depot  maintenance  be  done  on  contract  is  not  being 
followed  in  electronics  by  the  Army  and  Navy.  The  Army  con¬ 
tracts  out  about  7  percent  and  the  Navy  16  percent.  (The 

23 

Air  Force  figure  is  35  percent.) 

•  Because  of  increased  pay  rates  and  increased  turnover, 
training,  and  support  costs,  maintenance  by  uniformed  per¬ 
sonnel  is  likely  to  be  more  expensive  than  maintenance  by 

contractors  or  Civil  Service,  although  the  lack  of  good  cost 
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data  masks  the  issue. 

•  The  provision  of  maintenance  billets  at  U.S.  bases  to  ac¬ 
commodate  rotation  of  military  personnel  from  overseas  com¬ 
plicates  the  use  of  civilianization  as  a  cost-reducing  tech¬ 
nique.  Such  rotation  billets  should  be  carefully  identified 

as  a  cost  element  other  than  maintenance  so  that  their  cost 
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can  be  properly  ascribed. 

•  The  present  accounting  system  does  not  allow  a  i  lear  separa¬ 
tion  of  true  maintenance  costs  from  costs  of  nonmaintenance 
functions  performed  by  military  personnel  occupying  mainte¬ 
nance  billets.  Nor  does  the  system  allow  a  cost  comparison 

between  military  and  contractor  maintenance  or  between  two 
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different  military  facilities. 


Recommendations : 


As  recommended  earlier,  institute  a  cost  accounting  system 
that  will  afford  visibility  of  the  maintenance  process  and 
make  possible  realistic  ■  ost  comparisons  between  military 
and  industrial  maintenance.  Implementation  in  all  the  Serv¬ 
ices  of  the  Uniform  Depot  Maintenance  Cost  Accounting  and 
Production  Reporting  System  (OSD  Instruction  7220.29)  would 
be  an  important  part  of  such  a  system. 

Provide  separate  accounts  for  functions  other  than  mainte¬ 
nance,  such  as  the  use  of  U.S.  maintenance  billets  to  facili 
fate  the  rotation  of  military  personnel  not  involved  in 
maintenance,  or  for  personnel  in  training. 

★★★  Establish  alternative  sources  of  maintenance,  including  the 
maximum  feasible  amount  of  contractor  maintenance,  to  foster 
competition  and  resultant  efficiency  in  the  maintenance 
process  and  to  ensure  the  proper  utilization  of  scarce  mili¬ 
tary  personnel  in  the  present  zero-draft  environment. 

irk  Intensify  efforts  to  reduce  field  maintenance  by  shifting 
complex  tasks  from  the  organizational  and  intermediate 
levels  to  the  depots,  taking  due  account  of  increased  turn¬ 
around  time  and  transportation  problems. 


10.  Maintenance  Traininc 


Findings: 


•  There  is  high  turnover  among  electronics  maintenance  per¬ 
sonnel.  The  training  period  is  long,  and  personnel  seldom 
become  productive  until  the  end  of  the  initial  enlistment 
period.  The  median  level  of  experience  is  less  than  3 
years.  These  factors  result  in  an  expensive  and  unproduc¬ 
tive  maintenance  force,  high  training  cost  (averaging 

2  3 

$3000-$10 ,000  per  man-year),  arid  high  turnover.' 


★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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•  A  training  sequence  in  which  a  trainee  first  learns  to  per¬ 
form  maintenance  tasks  on  specific  equipments  and  defers 
learning  general  theory  gives  him  early  c apability  to  do 
productive  work  and  prepares  him  for  later  advanced  study. 

This  training  sequence  is  the  reverse  of  the  current 
24 

process . 

•  Successful,  speedy,  and  accurate  performance  of  maintenance 

tasks  by  green  technicians  can  be  made  possible  by  the  use 
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of  fully  proceduralized  job  performance  aids. 

Recommendations : 

Develop  fully  proceduralized  job  performance  aids  for  use  in 
routine  maintenance  of  new  weapons  systems  and  for  selected 
tasks  in  high-maintenance  portions  of  existing  systems. 

★★★  Selectively,  on  a  trial  basis,  reorient  the  training  se¬ 
quence  for  electronic  technicians  so  as  to  provide  first  the 
specific  training  they  require  to  perform  maintenance  tasks 
by  using  proceduralized  aids  during  their  initial  enlist¬ 
ments  . 

•  Increase  research  on  job  performance  aids  and  on  job-oriented 
training  to  enable  the  utilization  of  personnel  of  lower 
ability  levels  and  to  enhance  learning  on  the  job.  Apply 
the  results  in  selected  training  programs. 


11.  Warranties 


Findings: 


•  Long-term  contractor  maintenance  warranties  provide  a  tech¬ 
nique  by  which  both  production  and  maintenance  costs  can  be 

internalized  to  a  single  responsible  organization:  the 

,  .  2b 
supplier. 


■kirk  Highest  priority;  ★★  high  priority;  ★  priority. 
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•  Making  the  supplier-warrantor  responsible  for  both  produ  - 
tion  and  long-term  maintenance  costs  under  fixed-price  on- 
tracts  will  strongly  motivate  him  to  design  equipment  so  as 

to  reduce  the  sum  of  these  costs,  which  constitute  a  major 

2t> 

fraction  of  the  life-cycle  cost. 

•  The  limited  experience  with  long-term  contra  tor  maintcnan  < 

warranties  to  date  suggests  that  they  in  fact  motivate  dr  - 

signs  and  mollifications  to  increase  reliability,  and  that 

the  cost  of  contractor  maintenance  through  warranties  is 

substantially  less  than  just  the  direct  costs  of  military 
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maintenance  on  comparable  items. 

•  Short-term  warranties  on  materials  and  workmanship  have  been 
extensively  invoked  in  the  past  in  military  electronics  pro¬ 
curements,  but  such  warranties  have  been  ineffectual  and  are 

not  comparable  to  long-term  contractor  maintenance  war¬ 

ps 

ranties. 

•  The  use  of  long-term  contractor  maintenance  warranties  can 

serve  as  a  competitive  alternative  to  military  repair  of 
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electronic  equipment.  ’ 

•  Long-term  contractor  maintenance  warranties  have  application 

to  any  military  electronic  equipment  whose  failed  units  can 

be  replaced  in  the  field  and  conveniently  returned  to  the 

contractor  for  repair,  or  to  which  the  contractor  can  have 
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ready  access  for  field  repair. 

•  The  costs  of  warranty  maintenance  should  take  into  account 
the  cost  of  any  additional  spare  replacement  units  required, 
the  costs  of  transportation  for  repair,  and  the  warranty 
costs  themselves.  These  costs  should  be  compared  with  the 
costs  of  the  spare  components  and  the  logistic  system  re¬ 
quired  to  supply  them  to  the  field,  plus  the  true  direct 

25 

and  indirect  costs  of  military  maintenance . 
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•  Post -wu rr  arity  maintenance  options  in  1  i c i . >  warranty  renewal, 
maintenance  ontrarts,  or  ;  ontr.rt(  r  training  of  military 
maintenance  personnel.  Any  of  there  options  would  alleviate 

9< 

the  need  tor  excessively  detailed  data  and  manuals,' 

•  Trial  ippli  at. ion  of  long-term  ontrar t  maintenance  war¬ 
ranties  was  requested  or  the  Servicer,  by  DDR&E  and  ASD(IEL) 
iri  a  joint  memorandum  of  71  August  19  73. 

Recommendations : 

Extend  the  application  of  long-term  contractor  maintenance 
warranties  to  military  electronics  procurements. 

Make  known  the  intention  to  contract  for  maintenance  war¬ 
ranties  on  production  equipment  at  the  time  development  is 
initiated,  so  that  the  ontractor  will  design  to  minimize 
total  costs  of  production  anti  warranty  maintenance. 

★★★  Establish  a  warranty  review  group  within  OSD  to  monitor  re¬ 
sults  of  trial  appli -at Lens ,  to  determine  desirable  warranty 
contractual  formats,  ant!  to  refine  the  categories  of  equip¬ 
ments  to  which  warranties  are  most  applicable  and  for  which 
warranties  are  most  effective. 

Initially,  apply  long-term  contractor  maintenance  warranties 
to  equipments  whose  failed  units  can  be  rer laced  in  the 
field  and  conveniently  returned  to  the  contractor's  plant 
or  base  for  repair,  or  to  which  the  contractor  can  have 
ready  access  for  field  repair,  such  as:  airborne  communi¬ 
cation,  navigation,  and  identification  equipment;  modular 
radars;  vehicular  communication  sets;  complex  manpack  equip¬ 
ment  such  as  LORAN  C/D;  forward-looking  infrared  (FLIR)  sys¬ 
tems;  and  domestic  communication,  data  processing,  and  radar 
installations. 


★★★  Highest  priority;  -Hr  high  priority;  ★  priority. 


29 


12.  Design  Evolution  and  Configuration  Management 


Findings: 

•  A  new  DOD  regulation,  "Configuration  Management,"  is  in  the 
last  stages  of  signoff  prior  to  official  promulgation.  It 
will  establish  policies  and  practices  applicable  to  all  seg¬ 
ments  of  DOD.  As  it  now  stands,  this  draft  regulation  still 

8 

has  the  following  drawbacks: 

1.  It  unduly  restricts  the  freedom  required  by  a  supplier- 
warrantor  to  make  the  evolutionary  internal  design 
changes  he  sees  as  needed  to  increase  reliability  and 
thus  to  decrease  the  sum  of  unit  production  cost  plus 
unit  contractor  maintenance  warranty  cost. 

2.  It  imposes  a  configuration  baseline  at  the  end  of  full- 
scale  development.  Thus,  all  changes  after  this  point-- 
and  experience  snows  tnere  are  rr.dny--must  undergo  the 
formal  configuration-change  processing  routine,  a  routine 
that  has  olten  led  to  delays  in  the  past  despite  good 
intentions  and  reasonable  procedures. 

3.  Its  effect  would  be  to  restrict  the  freedom  required  to 
make  tradeoffs  between  cost,  performance,  schedule,  and 
quantity  in  design-to-cost  contracts. 

•  The  draft  regulation  oroperly  emphasizes  the  requirements 
for  meticulous  conf iguration-status  accounting  and  keeping 

g 

technical  do  umentation  current  with  the  configuration. 

Recommendations: 

★★★  The  about- to- be- promulgated  DOD  regulation  on  configuration 
management  should  be  adopted  with  the  following  modifications 

1.  It  should  specifically  permit  consideration  of  changes 
that  are  of  benefit  to  the  contractor  and  not  detrimen¬ 
tal  to  the  Government. 

Highest  priority;  ★★  high  priority;  ★  priority. 
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2. 


It  should  establish  two  product  baselines,  the  first  a 
"tentative”  one  at  the  end  of  full-scale  development, 
and  the  second,  "final”  one  when  the  design  has  been 
adequately  stabilized  (see  below). 

3.  It  should  permit  internal  equipment  changes  that  do  not 
affect  form,  fit  (compatibility  and  interfaces),  func¬ 
tion,  price,  or  delivery  to  be  classified  Class  II  (as 
defined  in  the  regulation)  in  order  to  facilitate  the 
change  approval  process  until  the  "final”  product  base¬ 
line  is  invoked  by  the  Government. 

***  The  Government  should  defer  invocation  of  the  final  product 
baseline,  as  applicable  to  electronic  equipment,  until  field 
reliability  objectives  have  been  achieved,  or,  in  the  case 
of  equipment  under  contract  maintenance  warranty,  until  the 
warranty  period  is  about  to  end  and  the  Government  is  about 
to  take  over  maintenance  from  the  warrantor. 

•kirk  The  Government  should  defer  full  spares  stocking  until  after 
the  final  product  baseline  is  invoked. 

13.  Project  Management 

Finding: 

•  Design  to  cost  is  a  concept  which  depends  for  its  success  on 
the  flexibility  and  timeliness  of  management  decisions. 

Such  decisions  are  usually  best  made  at  the  project -manager 
level,  provided  that  the  project  manager  has  the  requisite 
authority--f or  example,  sufficient  authority  to  shift  funds 
from  one  program  to  another  in  a  multiprogram  project  of¬ 
fice,  and  thus  to  defer  or  eliminate  lower  priority  tasks 
in  one  program  in  order  to  expedite  high-priority  tasks  in 
another  program.  This  reprogramming  authority  is  present  in 


kkk  Highest  priority;  high  priority;  ★  priority. 
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seme  r.ultiprogram  offices  but  is  absent  in- othe  i  o,  large!/ 

because  different  line  items  in  the  budget  are  often  on- 

trolled  by  different  "sponsors"  in  the  headquarter  organi- 
*  ? 
nation,  and  each  sponsor  guards  his  share  of  the  budget. 

Recommendations: 

***  Use  the  multiprogram  project  office  ("basket"  SPO)  structure 

for  all  independent  ele  trcnic  subsystem  development  where 
a  number  of  related  or  similar  developments  an  be  j rouped 
under  one  perpetual  project  manager  (PM)  to  provide  a  PM  c. 
higher  rank  and  greater  authority,  better  project  o.fie 
personnel,  more  responsive  support  from  functional  groups, 
and  more  tradeoff  flexibility. 

kirk  Provide  multiprogram  project  offices  with  suffi  ien.  . xexi- 
bility  in  the  use  of  available  R&D  funds  to  allow  the  neces¬ 
sary  traded f s  bv  the  PM  in  the  development,  OTsE,  and  LRIP 
phases . 

+*  Arrange  for  the  project  manager  or  prospective  project  man¬ 
ager  to  participate  in  drafting  the  operational  requirements 
before  developing  specif ications  ror  subsystems  under  his 
jurisdiction . 

++  Make  available  to  system  project  managers  catalogs  of  avail¬ 
able  electronic  equipment  that  show  current  price  and  reli¬ 
ability  figures  as  well  as  technical  descriptions. 

14 .  Standardisation  and  Spe  if ii  ations 

Findings: 

•  In  the  ’-apidly  moving  technology  ot  military  electronics, 
the  standardization  that  occurs  because  of  repeated  procure¬ 
ments  of  the  same  design  can  result  in  technological  stag¬ 
nation,  mediocre  reliability,  and  excessive  proliferation 


***  Highest  priority;  high  priority;  ★  priority. 
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of  alternative  equipments.  This  has  been  exemplified  by  the 
AN/ARC-34  UHF  radio  set  and  the  AN/ARN-21  TACAN.27 

•  By  way  of  contrast,  interface  standardization  at  the  black 
box,  LRU,  or  WRA  level  provides  a  practical  form  of  stand¬ 
ardization  which  has  been  shown  to  work  both  in  the  civilian 
airline  industry  and  in  military  mission-oriented  equipment, 
such  as  the  Navy’s  Standard  Missile.  As  used  by  the  airline 
industry,  the  interface  standardization  approach  is  combined 
with  functional  specifications,  that  is,  "form,  fit,  func¬ 
tion"  standardization.  This  has  the  advantage  that  while 
the  interface  is  standardized,  the  internal  configuration  of 
the  unit  can  evolve  as  technology  changes,  taking  advantage 
of  new  devices  and  new  materials.  Interface  standardization 
can  be  used  in  conjunction  with  military  standards  for  com¬ 
ponents  and  workmanship.  Limitations  on  the  evolution  in¬ 
side  the  unit  result,  but  these  specifications  provide  a 
degree  of  insurance  against  the  mistakes  of  an  incompetent 
or  greedy  vendor.  In  either  case,  technological  progress  is 
not  halted  by  standardization.  Moreover,  interchangeability 
between  old  and  new  generations  of  electronics  becomes  a 
practical  reality,  and  the  need  for  modifications  to  an  in¬ 
stallation  to  accommodate  the  new  equipment  is  eliminated. 
With  interface  standardization,  production  costs  can  be 
held  down  by  competition  among  interchangeable  designs,  and 

new  systems  can  be  synthesized  largely  from  proven  standard 
27 

units . 

•  Strict  military  environmental  requirements  imposed  on  equip¬ 
ment  and  systems  cause  great  increases  in  cost.  The  provi¬ 
sion  of  more  benign  standard  environments  for  electroni 
equipments  through  control  of  humidity  and  temperature'  and 
isolation  from  shock  and  vibration  would  make  possible  the 
use  of  cheaper  and  more  readily  available  devices.' 
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•  In  an  area  as  dynamic  as  electronic  technology,  the  vast  DOD 
system  of  military  standards  and  specif ications  is  too  slug¬ 
gish  to  follow  the  rapid  advances  in  technology.  But  by 
providing  instructive  guidelines  for  the  uninitiated,  it 
does  have  the  valuable  function  of  admitting  novices  in 

military  electronics  design  and  manufacture  to  the  competi- 

27 

tion  for  development  and  production  of  hardware. 

•  Integrated-circuit  development  is  being  driven  by  commercial 
rather  than  military  demand,  and  the  production  prices  of 
such  items  produced  j.r.  commercial  voJume  are  very  low.  Mili¬ 
tary  equipment  developers  should  make  use  of  the  existing 
library  of  commercial  MSI  and  LSI  components  where  feasible, 
rather  than  entering  into  uniquely  military  integrated - 

circuit  developments;  and  dependence  on  a  single  source  for 

28 

such  components  should  be  avoided  wherever  possible. 

•  The  impact  of  standardization  and  specifications  on  elec¬ 
tronics  cost  is  of  such  large  magnitude  that  establishing 

electronics  standardization  and  specification  policy  should 

27 

be  undertaken  in  the  Office  of  the  Secretary  of  Defense. 
Recommendations: 

DOD  should  establish  an  Electronic  Standards  Panel  having 
responsibility  and  authority  to 

l.  Promulgate  policy  requiring  that  the  Services  in¬ 
clude  electrical,  mechanical,  and  environmental 
interface  specifications  in  specifications  for 
electronic  equipment. 

irk  2.  Promulgate  policy  requiring  that  the  Services  take 
steps  toward  assuring  that  new  electronic  equip¬ 
ments  that  are  likely  to  replace  older  equipments 
in  aircraft,  ground  vehicles,  and  other  platforms 


Highest  priority;  ★★  high  priority;  ★  priority. 
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will  be  made  electrically,  mechanically,  and  en¬ 
vironmentally  interchangeable  with  the  older 
equipments,  of  similar  types,  so  that  the  new 
equipments  can  be  substituted  for  the  old  without 
costly  installation  modification. 

3.  Promulgate  policy  requiring  that  equipments,  sub¬ 
systems,  or  systems  of  similar  types  be  developed 
to  the  same  interface  specifications,  so  that  they 
may  be  interchanged. 

irk  4.  Promulgate  specific  interface  standards  for  classes 
of  equipment  used  by  more  than  one  Service. 

5.  Establish  and  promulgate  standards  for  the  thermal, 
atmospheric,  vibration,  shock,  mounting,  shielding, 
and  power- source  environments  to  be  provided  by 
aircraft,  ships,  and  vehicles  in  which  electronic* 
is  to  be  installed.  This  should  include  standards 
for  benign- environment  enclosures  wherever  they 
are  feasible  and  cost-effective. 

irk  6.  With  the  concurrence  of  and  to  the  extent  author¬ 
ized  by  the  Military  Communications  Electronics 
Board,  establish  and  promulgate  standards  for  the 
signals  to  be  transmitted  or  interchanged  in  co¬ 
operative  systems,  such  as  communications,  navi¬ 
gation,  and  identification  systems. 

★★  7.  Review  Service  forecasts  of  electronic  equipment 

needs  in  order  to  determine  those  types  and  classes 
to  which  uniform  standards  should  be  applied,  and 
act  to  ensure  that  they  are  applied. 

★★★  8.  Establish  and  promulgate  DOD  standards  for  the 

multiplexing  and  interchange  of  digi.al  data  among 
electronic  equipments  within  ships  and  aircraft. 

★★★  Highest  priority;  **  high  priority;  ★  priority. 
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9.  Promulgate  policy  designed  to  ensure  maximum  com¬ 
patibility  of  military  standards  with  commercial 
practices . 

irk  10.  Review  existing  standards  and  specifications  for 
parts,  materials,  finishes,  processes,  and  other 
aspects  of  the  internal  design  of  military  elec¬ 
tronics  to  determine  which  of  these  should  be 

a.  Strictly  enforced 

b.  Subject  to  the  substitution  of  the  contractor- 
validated  alternative 

c.  Regarded  as  advisory  only 

d .  Revoked . 

The  several  general  design  specifications  used  in 
most  electronics  procurements  (e.g.  ,  MIL-E-16400, 
MIL- E- 5400,  MIL- 1-983)  should  receive  particular 
early  attention. 

**  11.  .  Issue  up-to-date  guidance  on  military  utilization 
of  standard  commercial  LSI  and  MSI  items,  with 
particular  attention  to  the  need  for  multiple 
sources  and  avoidance  of  military- unique  designs. 

★★  DOD  Directive  4120.3  can  be  the  vehicle  for  the  establishment 
of  an  effective  electronic  standards  organization.  In  order 
to  accomplish  this ,  the  Defense  Materiel  Specifications  and 
Standards  Board  should,  under  paragraph  VII  B2  of  the  Direc¬ 
tive,  recommend  the  establishment  of  an  Electronic  Standards 
Panel  (ESP),  with  the  authority  and  i»3sponsibility  to  pro¬ 
mulgate  multi-Service  electronic  standards  and  promote  the 
cause  of  standardization  of  electronic  equipments,  subsystems, 
and  systems,  both  single- Service  and  multi-Service.  The  ESP 
should  be  given  the  further  authority  to  establish  continu¬ 
ing  (as  opposed  to  ad  hoc)  committees,  to  which  may  be 


kirk  Highest  priority;  kk  high  priority;  ★  priority. 
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delegated  segments  of  the  authority  and  responsibility  of 
the  ESP.  Once  established,  the  ESP  should  organize  to  under¬ 
take  formulation  and  promulgation  of  the  policies  recommended 
above . 

15.  Software 
Findings; 

•  Software  costs  have  exceeded  hardware  costs  by  large  factors 
in  some  military  systems  using  general-purpose  computers. 
Boehm,  of  the  Rand  Corporation,  reported  that  the  Air  Force 
in  1972  expended  between  $1  billion  and  $1.5  billion  on 
software  (that  is,  computer  programs  and  associated  docu¬ 
mentation)  --more  than  twice  its  expenditures  on  computer 

29 

hardware. 

•  Software  developments  are  frequently  behind  schedule,  causing 

29 

other  costs  to  spiral. 

•  Software  "unreliability"  is  a  euphemism  for  software 

29 

errors. 

•  The  complexity  and  extent  of  the  software  may  well  be  a 
measure  of  the  mismatch  between  the  hardware  and  the  prob¬ 
lem;  conversely,  by  properly  designing  and  structuring  the 

29 

processor,  the  software  problem  can  be  mitigated. 

•  The  major  sources  of  excessive  software  costs  in  conven¬ 
tional  systems  employing  central  uniprocessors  are  the 

29 

following; 

1.  Selecting  hardware  and  starting  programming  before  the 
system  is  designed  in  detail — that  is,  before  the  sys¬ 
tem  functions,  organization,  inputs,  outputs,  and  trans¬ 
fer  functions  are  thoroughly  defined.  The  flexibility 
of  the  digital  computer  is  used  as  an  excuse  to  pro¬ 
crastinate  in  system  design. 
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2.  Overburdening  the  central  processor  with  tasks  that 
can  be  accomplished  by  specialized  peripherals. 

3.  Selecting  too  small  a  central  processor,  with  consequent 
overutilization  of  the  computer  and  resort  to  bad  pro¬ 
gramming  practices. 

4.  Program  overintegration,  which  makes  changes  difficult. 

5.  Lack  of  adequate  discipline  in  software  development. 

6.  Developing  a  new  high-level  programming  language  for 
every  job. 

7.  Starting  programming  before  the  computer  design  is 
complete . 

Recommendations : 

To  reduce  costs  of  software  in  processors  employing  conventional 
general-purpose  machines,  our  recommendations  are: 

Complete  the  design  of  the  system  and  the  basic  program 
structure  in  substantial  detail  before  making  major  commit¬ 
ments  to  hardware  or  coding. 

irk  Limit  the  aggregation  of  problems  to  be  solved  on  a  central 
machine;  as  an  alternative,  decentralize  processing  by  pro¬ 
viding  peripheral  special-purpose  devices  (either  analog  or 
digital)  or  separate  peripheral  general-purpose  machines  to 
perform  specific  separable  functions. 

Select  a  processor  of  adequate  size  to  permit  underuti¬ 
lizing  the  computer;  write  highly  modular  programs;  empha¬ 
size  structure  and  overall  efficiency  rather  than  hardware 
efficiency  alone. 

irk  Use  rigorous  discipline  in  software  development,  such  as  the 

29 

top-down  Structured -Programming  approach. 


Highest  priority;  irk  high  priority;  ★  priority. 


*★  Use  a  standard  well-established  programming  language  with 
which  programmers  are  thoroughly  familiar.  Use  the  highest 
level  language  appropriate  to  the  task  at  hand,  but  avoid 
the  unnecessary  development  of  a  unique  language. 

Defer  coding  until  the  computer  design  is  substantially 
complete  and  firm,  except  for  that  necessary  to  verify 
hardware-sof tware  design  compatibility. 

16.  Digital  System  Architecture 

Findings: 

•  No  current  basis  exists  for  the  common  assumption  that  con¬ 
ventional  centralized  programmable  uniprocessors  are  the 

most  effective  or  most  economical  bases  on  which  to  struc- 

29 

ture  military  tactical  data  systems. 

•  The  cost  of  programming  is  escalating,  while  the  cost  of 

standard  computing  hardware  is  plummeting;  a  new  look  is 

needed  at  the  balance  between  hardware  and  software  in  sys- 

29 

tern  architecture. 

•  The  advent  of  large-scale  integration  has  led  to  the  cheap 

and  plentiful  implementation  in  hardware,  on  single  chips, 

of  standardized  complex  algorithms  together  with  memory. 

With  hardware  implementation  of  a  complex  algorithm,  the  need 

29 

for  writing  the  algorithm  in  software  is  eliminated. 

•  There  is  a  growing  library  of  these  hardware- implemented , 
standard,  complex  computing  functions  that  makes  possible 
the  synthesis  of  specialized  processing  units  and  the  elimi¬ 
nation  of  much  of  the  software.  The  low  cost  and  small  size 
of  these  units  mitigate  the  need  for  time-sharing  their  use, 
and  permit  distributed  processing,  federated  architectures, 

associative  array  processing,  and  processing  structures 

29 

specifically  tailored  to  system  functions. 


★★★  Highest  priority;  irk  high  priority;  ★  priority. 
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Recommendations ; 


The  principal  need  in  data-processing  system  design  is  a  rever¬ 
sion  to  the  engineer's  approach  of  first  analyzing  the  problem,  then 
laying  out  alternate  solutions,  and  then  choosing  and  pursuing  the 
most  effective  and  economical.  Specifically, 

***  System-function-oriented  processing- hardware  structures 
should  be  considered  as  alternatives  to  the  conventional 
centralized  programmable  uniprocessor  for  use  in  military 
tactical  systems. 

★★★  The  military  processing  problem  should  be  clearly  stated; 
the  system  design  should  be  spelled  out  in  detail;  and  al¬ 
ternate  processor  architectures  and  designs  should  be  com¬ 
pared  before  a  hardware  approach  is  selected. 

A  processor  design  for  each  system  should  be  selected  and 
developed  that  will  minimize  the  combined  costs  of  hardware 
and  software;  the  allocation  of  functions  between  hardware, 
software,  and  human  operators  should  be  consciously  worked 
out  prior  to  decision. 

Ir*  Standard  LSI  processing  elements  available  from  more  than 
one  source  should  be  used  to  the  maximum  extent  possible; 
development  of  uniquely  military  LSI  elements  should  be 
minimized. 

Military  laboratories  should  be  encouraged  to  investigate 
and  develop  processor  architectures,  including  federated 
architectures,  that  fit  military  problems  and  are  cost- 
effective.  Conversely,  their  extensive  efforts  in  the 
programming  of  conventional  uniprocessors  should  be  re¬ 
duced  to  bring  the  overall  program  into  better  balance. 

kk  Commercially  successful  processors  for  which  software 
already  exists  should  be  considered  for  DOD  applications 
wherever  appropriate. 

★★★  Highest  priority;  kk  high  priority;  ★  priority. 
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Formats  and  speeds  for  data  interchange  among  sensors,  actu¬ 
ators,  processors,  controls,  and  displays  should  be  stand¬ 
ardized  across  service  lines  and  for  as  wide  a  variety  of 
applications  as  practicable. 

17 .  Data  Costs 

Findings: 

•  The  cost  of  electronics  technical  data  to  DOD  is  very  large. 

It  consists  of  the  following:  an  estimated  annual  $600 

million  formally  charged  for  data;  hidden  costs  charged 

under  the  headings  of  "engineering"  or  other  categories  of 

direct  labor;  and  Government  costs  entailed  in  requesting, 

receiving,  reviewing,  handling,  or  storing  technical  data. 

On  the  average,  the  formal  cost  of  data  averages  about  10 

percent  of  RDT6E  contract  costs  and  5  percent  of  production 
30 

costs. 

•  The  largest  cost  items  are  handbooks  and  technical  manuals, 

which  comprise  some  35-50  percent  of  the  total  data  costs 
30 

for  electronics. 

•  The  data  requirements  are  so  massive  that  it  is  impossible 
for  Government  personnel  to  review  the  submitted  material 
or  to  test  its  validity.'*0 

•  Discussions  with  industry  representatives  show  that  the  re- 
procurement  data  submitted  in  response  to  contract  require¬ 
ments  are  not  the  data  used  for  actual  manufacture  in  the 
contractor's  plant;  the  plant  may  use  numerical  control 
tapes,  while  the  Government  data  may  consist  of  exquisite 
india  ink  drawings  on  mylar. 

t  The  submission  of  the  data  is  often  required  too  early  to 
be  valid.  For  example,  handbooks  and  provisioning  documents 
may  have  to  be  submitted  before  the  equipment  nosign  is 
stabilized . 

•  Many  of  the  data  items  required  overlap.*0 
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In  addition  to  these  observations  on  the  current  course  of  events, 
it  is  pertinent  to  note  that,  were  certain  of  the  recommendations  of 
other  sections  of  this  report  to  be  followed,  some  conventional  data 
requirements  would  be  reduced  or  eliminated. 

1.  Were  competitive  equipments  available  from  two  or  mere  sup¬ 
pliers,  the  need  for  reprocurement  data  would  be  eliminated. 

2.  If  direct  transfer  of  information  from  developer  to  second- 
source  supplier  were  encouraged  by  suitable  incentives,  the 
reprocurement  data  package  could  be  reduced  in  extent  and 
less  rigid  in  format. 

3.  If  equipments  were  repaired  by  contractors  under  warranty  or 
by  specialists  at  depots,  the  extensive  and  explicit  in¬ 
structional  documentation  required  for  organizational  re¬ 
pair  by  technicians  of  limited  capability  could  be  reduced, 
and  good  commercial-grade  handbooks  would  suffice. 

4.  If  competitive  prototyping  and  test  were  the  bases  for  ac¬ 
ceptance  of  equipment  designs,  the  need  for  voluminous  in- 
process  validation  data  would  be  reduced. 

Recommendations : 

★  A  cept  contractor's  data  format  unless  there  is  a  demon¬ 
strable  advantage  in  specifying  a  Government  format. 

Defer  the  ordering  and  delivery  of  contractor  data  until  the 
need  is  firmly  established. 

★★  Delay  procurement  of  spares  provisioning,  technical  manuals 
and  maintenance  handbooks  until  the  point  of  design  stabili¬ 
zation  is  identified  and  reached. 

irk  Scrub  data  requirements  mercilessly  through  the  efforts  of 
Data  Requirements  Review  Boards  that  include  represer tation 
of  the  project  manager,  the  user,  and  industry. 


★★★  Highest  priority;  high  priority;  ★  pridrity. 
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•  Where  the  equipment  future  is  uncertain,  buy  options  on 
reprocurement  data  instead  of  the  data  itself. 

The  following  recommendations,  previously  made  in  other  contexts, 
have  been  recast  below  to  reflect  their  impact  on  data  costs  where 
applicable . 

•  Use  competing  suppliers  of  interchangeable  equipment  to  re¬ 
duce  the  need  for  reprocurement  data. 

•  Use  contractor  warranties  and  maintenance  to  reduce  the 
need  for  technical  and  maintenance  manuals  and  provisioning 
data. 

•  Rely  on  competitive  prototyping  and  test  as  a  substitute 
for  voluminous  in-process  validation  data  (and  as  a  sub¬ 
stitute  for  myriad  detailed  specif icatic  s). 

•  As  an  alternative  to  formal  and  highly  detailed  reprocure¬ 
ment  drawings  and  specifications,  require  less  formal  draw¬ 
ings  and  encourage  more  informal  information  transfer.  For 
reprocurement  data,  pay  a  fixed  amount  for  the  drawings  plus 
a  fixed  amount  for  each  equipment  successfully  delivered  by 
the  second  source. 


Highest  priority;  high  priority;  ★  priority. 
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REFERENCES  AND  NOTES  FOR  PART  I 


1.  In  this  table,  RDT&E,  Procurement,  and  Support  each  includes 
those  portions  of  O&M  and  Military  Personnel  costs  that  are  al¬ 
locable  to  that  category.  Support  costs  further  include  depre¬ 
ciation  of  maintenance  equipment  and  facilities,  spares  costs, 
and  warranty  costs.  Hie  figures  quoted  entail  a  number  of  judg¬ 
ments  in  the  allocations ,  and  these  limit  their  accuracy  some- 
vdiat  without  affecting  the  validity  cf  the  conclusions  based  on 
them.  For  a  more  detailed  breakdown,  see  Table  II- 2  in  Section 
II-G  of  this  report.  For  a  detailed  discussion,  see  Appendix  B. 

2.  The  data  in  Fig.  II- 5,  Section  II-H  of  this  report,  show  a  sta¬ 
tistical  relation  between  unit  production  cost  of  avionics  equip¬ 
ment  and  mean  flight  hours  between  failures  (MFHBF);  namely, 

Unit  Production  Cost  x  MFHBF  =  $1.3  x  10^  x  hours. 

Since  the  costs  of  support  are  roughly  proportional  to  (1/MFHBF), 
this  implies  that  unit  support  cost  is  proportional  to  unit  pro¬ 
duction  cost.  An  analogous  conclusion  is  reached  in  IDA  Study 
S-392,  Avionics  Performance  and  Costs,  Vol.  17,  December  1971, 
relative  to  the  more  narrowly  defined  maintenance  cost  (direct 
labor,  materials,  and  replacement  spares)  being  proportional  to 
unit  equipment  cost. 

3.  Sections  III-A-2,  III-A-3,  and  IV-G  of  this  report. 

4.  Section  III- A- 5  of  this  report. 

5.  Annex  to  Section  III- A  of  this  report. 

6.  Section  III-B  of  this  report. 

7.  Section  III-C  of  this  report. 

8.  Section  IV-D  of  this  report. 

9.  Section  IV- B  of  this  report. 

10.  Section  III-C  of  this  report,  as  well  as  address  by  Dr.  John  S. 

Foster,  Jr.,  before  Armed  Forces  Management  Association/National 
Security  Industrial  Association  Symposium,  16  August  1972. 


Preceding  past  blank 
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11. 


Table  HI- 30,  Section  III-C-4  of  this  report. 

12.  Fig.  II- 5  and  associated  text. 

13.  Section  III-D  of  this  report. 

14.  Section  IV- A  of  this  report. 

15.  Section  III-E  of  this  report,  particularly  Tables  III- 33  and  HI- 
34.  Also,  Office  of  the  Assistant  for  Cost  Analysis,  U.S.  Army 
Safeguard  Systems  Office,  Should  Cost/Will  Cost/Must  Cost — A  The¬ 
ory  of  the  Cause  of  Cost  Growth,  June  1972. 

16.  Section  III-E  of  this  report. 

17.  See  also  Electronics-X  Working  Papers  21  and  23,  available  at 
the  IDA  Library. 

18.  Section  III-F-1  of  this  report,  particularly  data  such  as 
Table  III- 35. 

19.  Section  III-F-1  of  this  report. 

20.  Based  in  part  on  numerous  discussions  with  industry  personnel  who 
cannot  be  quoted  directly. 

21.  Section  III-F-2  of  this  report. 

22.  Table  I I- 2  and  Appendix  B  to  this  report. 

23.  Section  III-G  of  this  report. 

24.  Section  III-G-2  of  this  report. 

25.  Section  IV-A  of  this  report. 

26.  Section  J.V-E  of  this  report. 

27.  Section  IV- B  of  this  report. 

28.  Section  II-J  of  this  report. 

29.  Section  IV-C  of  this  report. 

30.  Section  IV-F  of  this  report. 
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II.  BACKGROUND  AND  UNDERLYING  ISSUES 
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It  is  common  sense  to  take  a  method  and  try  it.  If 
it  fails ,  admit  it  frankly  and  try  another.  But 
above  allt  try  something . 

--Franklin  Delano  Roosevelt 


A.  TASK 

The  Electronics-X  Study,  as  stated  in  the  Defense  Advanced  Re¬ 
search  Project  Agency's  task  assignment1  to  IDA,  was  "to  identify  and 
evaluate  current  and  alternative  DOD  and  industry  policies,  procedures 
and  practices  in  development,  production  and  operational  support  (of 
military  electronics  equipment)  which  most  significantly  influence 
acquisition  and  life  cycle  costs  and  field  reliability  and  to  recom¬ 
mend  changes  and  improvements  to  reduce  and  control  such  costs  and 
improve  reliability."  The  study  has  taken  into  account  the  published 
results  of  concurrent  related  efforts  undertaken  under  DDR&E  sponsor¬ 
ship  by  other  organizations. 

The  program  sponsor  requested  that  the  study  recommendations  give 
emphasis,  where  possible,  to  specific  mechanisms  by  which  the  Depart¬ 
ment  of  Defense  might  implement  recommended  changes  in  policies,  prac¬ 
tices,  and  procedures,  and  that  the  relative  impact  of  implementing 
the  recommendations  be  assessed. 


B.  PURPOSE 

The  motivation  for  the  Electronics-X  task  assignment  is  given  in 
the  following  statement:1  "Sharply  rising  costs  of  electronics  sys¬ 
tems  and  unsatisfactory  field  reliability  mandate  an  initiative  by 
DDR&E  to  lower  the  costs  of  military  electronics  equipment  and  improve 
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!its  field  reliability/maintainability,  while  still  attaining  accept¬ 
able  performance  and  schedules.”  In  later  sections  (II-H  and  II-I) 
we  shall  discuss  the  validity  of  the  foregoing  assertion  and  of  the 
underlying  assumption  that,  in  fact,  electronics  costs  can  be  reduced 
and  reliability  improved. 

C.  SPONSOR 

I 

The  Electronics-X  effort  was  sponsored  by  the  Assistant  Director 
(Planning),  Office  of  the  Director  of  Defense  Research  and  Engineering. 

5 

D.  RELATED  EFFORTS 

! 

Several  important  study  efforts  have  been  completed  in  the  re¬ 
cent  past,  the  objectives  of  which  were  exposing  and  suggesting  solu¬ 
tions  to  the  problems  of  military  equipment  acquisition,  reliability 
and  maintenance.  The  reports  of  the  efforts  on  which  the  Electronics-X 
Study  has  drawn  most  heavily  are: 

-  Report  of  the  Defense  Science  Board  Task  Force  on  Weapon- 
System  Simplification  (.1970  Summer  StuHy),  sometimes  known  as 
"the  Phillips  Report,”  which  considers  the  problem  of  over¬ 
specification  of  U.S.  weapon-system  capability.  The  report 
recommends  early  establishment  of  weapon-system  cost  goals, 
iterative  examination  of  alternative  solutions  and  their 

I 

co  ts,  and  continuing  tradeoffs  of  performance,  cost,  and 
schedule  throughout  the  development  cycle;  recognition  of  ex¬ 
cessive  projection  of  enemy  threats;  identification  of  the 
few  inviolable  weapon-system  performance  requirements;  use  of 
proven  components  and  subsystems;  competitive  prototyping; 
authority  to  reprogram  cost  savings;  and  purging  of  unneces¬ 
sarily  detailed  specif ications  and  requirements  and  of  the 
offices  that  generate  them. 

Report  of  the  Defense  Science  Board  Task  Force  on  Avionics  (U), 
February  1973  (S),  sometimes  known  as  "the  Fubini  Study," 
which  pointed  out  that  tactical-mission  avionics  acquisition 
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costs  are  rising  rapidly  while  defense  equipment  budgets  are 
declining,  leading  to  an  almost  inevitable  reduction  in  force- 
levels;  and  that  these  acquisition  costs  are  but  the  tip  of  an 
iceberg:  invisible,  below  the  surface,  lie  the  massive  in¬ 
stallation  and  maintenance  costs,  which  constitute  50  percent 
or  more  of  avionics  life-cycle  costs. 

-  Report  of  the  Defense  Science  Board  Task  Force  on  Reducing 
Costs  of  Defense  System  Acquisitions,  March  15,  1973,  some¬ 
times  known  as  "the  Bucy  Report,"  which  compared  military  and 
industrial  practices  in  the  development  and  procurement  of 
defense  systems. 

-  Report  of  the  Commission  on  Government  Procurement,  December 
1972,  which  dealt  with  the  promotion  of  economy,  efficiency, 
and  effectiveness  in  the  procurement  of  goods  and  services  by 
the  Executive  Branch  of  Government. 

-  Cost  Growth  in  Major  Weapons  Systems,  March  26,  1973,  a  report 
by  the  Comptroller  General  of  the  United  States  to  the  Com¬ 
mittee  on  Armed  Services,  House  of  Representatives,  concerned 
with  the  problem  of  unforeseen  cost  escalation  in  military 
procurement  and  recommending  adoption  of  certain  managerial 
practices . 

As  further  background,  Report  From  Wasteland,  written  by  Senator 
William  Proxmire,  a  severe  critic  of  current  Defense  Department  prac¬ 
tices,  has  proved  educational.  It  challenges  not  only  che  efficiency 
but  also  the  integrity  of  the  military  procurement  process. 

E .  FOCUS 

There  are  three  specific  differences  between  the  Elec  tronics-X 
Study  and  those  major  efforts  that  have  preceded  it.  The  first  and 
most  obvious  of  these  is  in  the  focus  of  Electronics-X  on  military 
electronics  as  a  whole,  as  opposed  to  the  broader  perspective  of 
weapons  systems  or  the  narrower  view  of  avionics. 


r 


The  second  difference  between  the  Electronics-X  Study  and  most 
of  those  that  preceded  it  is  that  it  focuses  on  reduction  of  total 
cost  of  ownership,  rather  than  just  reduction  of  acquisition  costs. 

The  study  has  been  impelled  in  this  direction  by  the  Fubini  Study, 
which  pointed  up  the  large,  largely  uncontrollable,  post -acquisition 
costs  of  ownership  of  electronic  equipment. 

The  third  aspect  of  this  study  that  mc'kes  it  different  is  its 
focus  on  the  policies,  practices,  and  procedures  by  which  the  Depart¬ 
ment  of  Defense  may  reduce  *-he  cost  and  increase  the  reliability  of 
the  electronic  equipment  it  buys  and  uses. 

F.  WHAT’S  DIFFERENT  ABOUT  ELECTRONICS? 

It  is  useful  to  list  those  characteristics  that  set  electronics 
apart  from  other  items  procured  by  the  military,  in  order  that  one  may 
understand  why  electronics  is  or  should  be  treated  differently. 

First,  although  electronics  may  stand  alone  in  communications, 
surveillance,  electronic  warfare,  or  tactical  data  processing  systems, 
it  is  most  commonly  found  imbedded  in — and  more  or  less  integral 
with--weapons  systems,  the  capabilities  of  which  are  dependent  upon 
electronic  elements.  Electronic  equipment  represents  a  large  and 
growing  fraction  of  military  weapons  systems.  Roughly  80  percent  of 
the  dollar  value  of  military  electronics  is  in  aircraft,  missile,  and 
ship  installations  (Table  II-l). 

Second,  the  explosive  technological  growth  in  electronics  has, 
in  recent  times,  been  far  more  rapid  than  tha  growth  of  any  other 
branch  of  military  technology.  Efforts  at  raking  advantage  of  this 
evolution  in  the  context  ot  system  acquisition  practices  geared  to 
more  stable  technologies  have  led  to  acquisition  and  maintenance  cost 
excesses.  Approaches  specific  to  electronics  appear  to  be  warranted. 

Third,  the  rate  of  development  of  electronics  is,  in  several 
areas  such  as  microelectronics,  information  processing,  and  display 
technology,  driven  by  commercial  rather  than  military  markets — an 
abrupt  turnabout  from  previous  years.  On  the  other  hand,  the  rapid 
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technological  advances  in  light  intensif iers,  lasers,  infrared  de¬ 
tectors,  inertial  sensors,  phased  arrays,  and  cryogenic  systems  are 
still  driven  by  military  rather  than  commercial  needs. 

TABLE  II -1.  ELECTRONICS  COSTS  FOR  WEAPONS  SYSTEMS  AS  PERCENTAGES 
OF  WEAPON-SYSTEM  PROCUREMENT  COSTS  AND  OF  ELECTRONICS 

PROCUREMENT  BUDGET 


Percentage  of  Percentage  of 

Electronics  Weapon-System  Electronics 

for:  Procurement  Cost3  Procurement  Budget 


Aircraft 

30% 

31% 

Missiles 

75 

33 

Ships 

20 

16 

Ordnance  and 

Vehicles 

6 

4 

Communication 
&  Electronic 

100 

16 

Systems 

aSource:  Ref.  2. 

G.  MAGNITUDES  OF  MILITARY  ELECTRONICS  EXPENDITURES  AND  INVENTORY 

The  budget  of  the  Department  of  Defense  for  FY  1974  is  $81.1 
billion.  Of  this  total,  $8.1  billion  is  allotted  to  RDT&E,  $16.5 
billion  to  procurement,  $21.7  billion  to  operations  and  maintenance, 
and  $22.5  billion  to  military  pay  and  allowances.  The  total  elec- 
tronics  content  of  the  DOD  budget  is  estimated  at  $15.3  billion, 
allocated  among  RDT&E,  procurement,  and  maintenance  as  in  Table  II -2. 

The  clear  preponderance  in  the  Government’s  share  of  maintenance 
expenditures,  which  amounts  almost  to  a  Government  monopoly,  is  sig¬ 
nificant.  Its  problems  and  its  virtues  will  be  discussed  subse¬ 
quently.  As  discussed  in  Appendix  B  (in  Vol.  2),  there  is  an  evident 
dominance  of  indirect  costs  over  direct  costs  that  contributes  to 
severe  estimating  uncertainties,  a  problem  that  will  be  discussed  in 
a  later  chapter. 
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TABLE  II -2.  ALLOCATION  OF  TOTAL  ESTIMATED  ELECTRONICS 
CONTENT  OF  FY  1974  DOD  BUDGET  AMONG  RDT&E, 
PROCUREMENT,  AND  MAINTENANCE 


Billions 


RDT&E 

Electronics  Content,  RDT&E  Contracts  $2.9 

Government  In-House  Electronics  RDT&E  1.2 


Total  Electronics  Content,  RDT&E 


$  4.1 


Procurement 

Electronics  Content,  Aircraft  Procurement  $1.6 

Electronics  Content,  Missile  &  Space  1.7 

Procurement 

Electronics  Content,  Ship  Procurement  0.8 

Electronics  Content,  Ordnance  &  Vehicle  0.2 

Electronics  Content,  Electronics  &  0.8 

Communications  Procurement 

Government  In-House  Electronics  0.7 

Procurement  Support  - 

Total  Electronics  Content,  Procurement  5.8 

Maintenance 

Contract  Electronics  Maintenance  $0.4 

&  Support 

Government  In-House  Electronics  5.0 

Maintenance  - 

Total  Electronics  Content,  Maintenance3  5.4 


TOTAL  ESTIMATED  FY  1974  MILITARY 
ELECTRONICS  EXPENDITURES 


$15.3 


aSource:  Ref.  2. 


The  value  of  the  in-use  electronics  inventory  is  a  question  of 
interest,  since  it  is  this  inventory  that  determines  the  requirements 
for  electronics  maintenance.  From  Appendix  B,  the  inventory  is  esti¬ 
mated  as  shown  in  Table  II-3. 
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TABLE  II-3.  ELECTRONICS  CONTENT  OF  DOD  EQUIPMENT  INVENTORY 

(dollars  in  billions) 


All 

Equipment 

Electronics 

Content 

Electronics 

Percentage 

Military  Equipment  in  Use 

$110.1 

$31.1 

28% 

Military  Equipment  in 

Supply  System 

44.1 

9.7 

22 

Total  DOD  Inventory 

$154.2 

$40.8 

26% 

The  sheer  magnitude  of  the  $15.3  billion  figure  associated  with 
military  electronics  expenditures  for  a  single  year  is  impressive  and 
provides  such  leverage  that  even  small  improvements  in  acquisition  and 
maintenance  practices  can  potentially  save  large  amounts  of  money. 

The  huge  cost  of  electronics-related  support  has  not  been  amenable  to 
accurate  estimate,  largely  because  of  the  inadequacy  of  the  DOD  cost 
accounting  system  in  establishing  the  cost  of  direct  labor  and,  more 
particularly,  overhead  to  repair  electronic  equipment  and  systems 
that  fail  in  field  operation.  Our  estimate  indicates  the  total  FY 
1574  electronics  maintenance  costs  to  be  about  $5.4  billion,  or  an¬ 
nually  about  17  percent  of  the  estimated  in-use  electronics  inventory 
value  of  $31.1  billion. 

The  astonishing  aspect  of  our  estimates  is  that  in  FY  1974  the 
electronics  support  cost  almost  equals  the  electronics  procurement 
cost.  Because  force  readiness  and  combat  capability  depend  on  effec¬ 
tive  support  of  existing  weapons,  in  periods  of  declining  military 
budgets  and  rising  manpower  costs,  such  as  the  current  epoch,  one  can 
expect  support  expenditures  to  decline  more  slowly  than  procurement 
expenditures,  and  the  ratio  of  support  expenditures  to  procurement 
expenditures  to  increase. 
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H.  VALIDITY  OF  THE  STATEMENT  OF  TOE  PROBLEM 

Despite  the  increasing  utilization  of  electronics  in  military 
weapons  systems  and  the  increasing  dependence  of  these  weapons  sys¬ 
tems  upon  electronics  for  attainment  of  the  specified  weapon-system 
performance,  the  percentage  of  the  defense  budget  going  to  electronics, 
excluding  electronics-associated  military  personnel  costs,  is  declin¬ 
ing.  Figure  II -1  shows  the  estimate  of  the  Electronic  Industries  As¬ 
sociation  (EIA)^  of  the  electronics  content  of  the  defense  budget  for 
Fiscal  Years  1962-1974.* 


FIGURE  1 1-1.  Electronics  Content  of  the  Defense  Budget  (EIA  Estimates) 


The  EIA  estimates  are  smaller  than  ours,  but  are  used  here  to  pre¬ 
serve  consistency  in  the  method  of  estimating  over  the  13-year 
period  depicted. 
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During  the  period  1960-1970,  Pelehach  estimates  that  electronic 
reliability  on  a  per-part  basis  has  grown  by  an  average  factor  of  4, 
as  illustrated  in  Fig.  II-2. 


FIGURE  11-2.  Avionics  Reliability  Trends 

It  is  paradoxical,  then,  that  electronics  is  seen  to  be  increas¬ 
ing  in  cost  and  to  be  of  unsatisfactory  reliability,  and  it  is  im¬ 
portant  to  the  discussion  that  follows  that  the  reasons  underlying 
this  perception  be  understood. 

One  aspect  of  concern  lies  in  the  rising  cost  of  military  man¬ 
power,  which  now  constitutes  32  percent  of  the  military  budget,  as 
opposed  to  26  percent  in  1964.  The  economic  cost  of  an  Army  elec¬ 
tronics  technician  at  the  E-b  level,  tor  example,  has  risen  39  percent 


since  1966. 6  During  the  same  period,  the  implicit  GNP  deflator  has 
risen  by  only  28  percent.  Secondly,  the  military  electronics  inven¬ 
tory  is  estimated  to  have  grown  by  10  percent  in  the  last  four  years. 
Such  growth,  combined  with  the  increase  in  cost  of  the  personnel 
needed  to  maintain  the  inventory,  would  account  for  a  perceived  es¬ 
calation  in  the  aggregate  cost  and  the  fraction  of  the  budget  devoted 
to  electronic  maintenance.  Finally,  individual  electronic  systems 
and  subsystems  are  getting  bigger  (Fig.  II-3),  costlier,  and  more  com- 
plic  ated . 

Figure  II-4  illustrates  the  cost  growth  trend  for  new  types  of 
combat  aircraft.6  An  average  growth  rate  ever  more  than  five  decades 
of  about  12  percent  per  year,  or  a  factor  of  3.1  per  decade,  is  indi¬ 
cated.  Though  the  electronics  content  varies  from  aircraft  to  air¬ 
craft,  the  average  electronics  fraction  of  total  aircraft  cost  has 
increased  from  about  10-20  percent  in  the  1950s  to  20-30  percent  in 
the  late  1960s  and  early  1970s.7  Thus,  the  new-generation  avionics 
cost  increases  at  a  rate  of  perhaps  18  percent  per  year,  more  rapidly 
than  the  new-generation  aircraft  cost.  Though  combat  aircraft  have 
been  used  as  an  example,  similar  trends  exist  in  other  weapon  systems. 

The  relationship  between  unit  production  cost  and  field  relia¬ 
bility  is  illustrated  for  Air  Force  avionics  equipment  by  Fig.  II -5, 

g 

the  data  points  of  which  have  been  drawn  from  e  number  of  sources, 
and  include  tube,  transistor,  integrated-circuit,  and  hybrid  equip¬ 
ments  of  various  vintages.  Both  cost  and  reliability  are  functions 
of  equipment  complexity.  As  complexity  incrc^es,  cost  increases  and 
reliability,  as  measured  by  mean  flight  I  .ours  between  failures  (MFHBF), 
decreases.  Thus,  Fig.  II -5  shows  a  median  relationship*  in  which 

MFHBF  =  1.3  x  106/cost  . 


A  similar  relationship  based  on  limited  data  is  found  for  Army  Area 
Communications  Systems  (AACOMS):  Field  MTBF  =  107/oost. 
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CALENDAR  YEAR 


1950 


FIGURE  II- 


1955 


3.  Avionics  System  Weight  Trend  in  Attack  and  Interceptor  Aircraft 
(from  Pelehach) 
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FIGURE  11-4.  Cost  of  Combat  Aircraft 
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FIGURE  11-5.  Avionics  Field  Reliability  versus  Unit  Production  Cost 
( See  Appendix  E  for  source  data ) 


From  this  relationship,  field  reliability  of  avionics  can  be  crudely 
predicted  (within  a  factor  of  3)  when  cost  is  known.  If,  for  example, 
an  equipment  costs  $100,000,  it  can  be  expected  to  have  an  MFHBF  of 
13  hours;  if  it  costs  $1,000,  the  expected  MFHBF  is  1,300  hours. 

The  inverse  MFHBF-versus-cost  relationship  of  Fig.  II -5  explains 
the  frequent  occurrence  of  the  question,  "Why,  when  my  electronic 

9 

equipment  is  so  expensive,  is  it  so  unreliable?"  It  also  shows  why 
annual  repair  costs  for  avionics  can  be  crudely  estimated  as  a  con¬ 
stant  fraction  of  production  cost:  failure  rate  is  proportional  to 
production  cost,  and  annual  repair  costs  are  proportional  to  failure 
rate . 

It  now  becomes  much  clearer  why  electronics  cost  and  reliability 
excite  concern.  The  costs  of  new-generation  weapons  systems  elec¬ 
tronics  have  been  rising  at  rates  of  between  15  and  20  percent  per 
year,  which  means  that  the  number  of  weapons  systems  that  can  be  pur¬ 
chased  from  a  fixed  budget  is  rapidly  declining.  At  the  same  time, 
the  annual  15  percent  rate  of  growth  in  reliability  of  electronics  as 
technology  advances  is,  at  best,  barely  keeping  pace  with  the  rate  at 
which  the  complexity  of  new-generation  weapons  systems  electronics  is 
increasing,  with  the  result  that  electronic  subsystem  reliability  is 
at  a  standstill. 

I.  IS  THE  PROBLEM  SOLVABLE? 

Simplify  t  simplify . 

--Henry  David  Thoreau 

The  question  remains:  Can  the  problems  of  excessive  cost  and 
inadequate  reliability  of  military  electronic  equipment  be  solved? 

Figure  II-5  yields  indications  of  potential  solutions.  The  first 
of  these  derives  from  the  empirically  observed  trend  showing  that  re¬ 
liability  goes  down  when  unit  production  cost  goes  up.  An  equipment 
of  half  the  unit  production  cost  (and,  consequently,  half  the  com¬ 
plexity)  of  another  can  be  expected  to  have  twice  its  reliability. 
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This  suggests  that  if  requirements  can  be  purged  of  complicating  but 
unnecessary  performance  stipulations,  and  if  equipment  specifications 
can  be  stripped  of  difficult  but  nonessential  design  demands,  simul¬ 
taneous  reduction  in  cost  and  improvement  in  reliability  might  be 
attained . 

The  second  observation  to  be  made  from  Fig.  II- 5  is  that  there  is 
substantial  spread  in  the  results:  certain  equipments  are  three  or 
more  times  more  reliable  in  the  field  for  a  given  cost  than  the  median. 
Among  these  are  three  data  points  in  Fig.  II- 5  that  deserve  special 
attention. 

All  three  represent  cost  versus  reliability  for  avionic  equipments 
that  underwent  special  programs  for  the  development  of  reliability. 

(The  results  of  the  three  are  not  directly  comparable  to  each  other  be¬ 
cause  of  differences  in  operating  environment  and  methods  of  reliabil¬ 
ity  measurement.)  The  point  R  represents  the  General  Electric  AN/APQ- 
113  radar10’11  for  the  F-lll  aircraft.  The  point  WL  represents  the 
Bendix  RDR-1F  weather  radar  used  by  commercial  airlines  and  maintained 
by  the  supplier  under  contractor  maintenance  warranty.  The  point  WF 
represents  the  Delco  Carousel  IV  inertial  navigator  used  by  commercial 
airlines  and  the  U.S.  Air  Force  and  also  required  to  be  maintained 
under  warranty.  For  these  it  can  be  deduced  that  there  existed  design, 
workmanship,  and  parts- selection  criteria  and  development  approaches 
that  yielded  very  superior  results,  and  it  may  be  inferred  that  these 
approaches  can  be  found  for  other  systems  and  applied,  if  there  is 

adequate  incentive  to  do  so.  The  search  for  such  approaches  forms  a 
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major  theme  of  this  report.  ’ 

The  relationship  of  MFHBF  to  unit  production  cost  shown  in  Fig. 
II-5  suggests  a  realizability  criterion  for  avionics  reliability,  in 
the  absence  of  a  more  direct  criterion  based  on  complexity  and  tech¬ 
nology.  A  realizability  criterion  is  essential  to  answering  such 
questions  as,  "Is  my  equipment  as  reliable  as  it  could  be?"  and 
"Which  are  the  problem  equipments?"  From  Fig.  II-5,  it  appears  that 
the  superior  equipments  attain  a  field  MFHBF  of  about  6  x  10^/cost, 
as  opposed  to  the  median  of  1.3  x  10^/cost. 
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With  the  knowledge  of  what  is  attainable  with  difficulty  and  what 

V 

is  commonly  achieved,  one  can  take  a  further  step  to  establish  an  un¬ 
acceptability  criterion  for  avionics  reliability.  Figure  II-5  repre¬ 
sents  observed  results,  but  many  of  the  equipments  represented  are 
old,  using  vacuum-tube  technology,  and  represent  designs  in  which 
reliability  was  given  little  or  no  attention.  New  equipments  should 
easily  exceed  the  old  median  results.  The  reliability  attainable  with 
special  effort  in  development  exceeds  the  old  median  by  a  factor  of 
4.6.  Thus,  a  suggested  lower  limit  of  acceptability  is  the  old  median: 

Field  MFHBF  =  1.3  x  106/cost  . 

Applying  this  criterion  to  the  existing  avionics  inventory  would, 
of  course,  indicate  that  half  the  models  in  the  inventory  have  less 
than  readily  achievable  reliability  and  should  be  candidates  for  im¬ 
provement  or  replacement. 

J.  MILITARY  UTILIZATION  OF  ADVANCING  ELECTRONICS  TECHNOLOGY 

For  the  commercial  market,  the  advance  of  technology  has  meant, 
in  part,  successive  reductions  of  cost  and  weight  and  increased  reli¬ 
ability  for  given  functional  components  and  systems.  As  a  typical 
example,  an  electronic  calculator  of  1962  vintage  had  about  3000  tran¬ 
sistors,  weighed  40  lb,  and  was  priced  at  $2200,  while  the  equivalent 
1973  calculator  performs  identical  functions,  uses  two  MOS  devices, 
weighs  2  lb,  and  costs  $170.  Such  evolution  in  many  areas  has  opened 
vast  new  markets  and  led  to  rapid  expansion  of  commercial  electronic 
manufactures.  In  industrial  applications,  modern  electronic  tech¬ 
nology  has  permitted  the  development  of  new  devices  and  systems  to 
perform  functions  that,  previously,  could  only  be  done  with  diffi¬ 
culty  or  not  at  all.  The  examples  of  computing  cash  registers,  com¬ 
puterized  system  and  process  controls,  electronic  ignition  and  skid 
control  in  automotive  design,  and  automated  warehouses  suggest  the 
broad  range  of  products  and  markets  thus  made  available. 
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In  contrast,  until  the  recent  advent  of  the  "design-to-cost" 
philosophy,  little  effort  was  devoted  by  the  Services  to  the  applica¬ 
tion  of  new  technology  to  military  electronics  with  the  specific  ob¬ 
jective  of  reducing  costs  (or  increasing  reliability)  while  preserving 
performance.  Rather,  technological  advances  have  been  used  to  increase 
performance,  obtain  greater  precision,  and  add  functions  to  the  extent 
f easible--of ten  at  substantial  cost  in  dollars  and  reliability  because 
of  the  sheer  magnitude  of  the  increase  in  number  of  circuits  and  com¬ 
ponents  or  the  exquisite  manufacturing  precision  required.  The  fol¬ 
lowing  unit  hardware  production  cost  increments  crudely  indicate  the 
cost  of  adding  performance  to  military  electronic  systems: 

-  To  extend  the  range  of  an  air-to-air  radar,  about  $6, 000/mile. 

-  To  go  from  a  basic,  noncoherent  airborne  radar  that  can  show 
large  terrain  features  to  an  attack  radar  svstem  with  MTI, 
accurate  mapping,  ranging,  and  resolution  of  a  few  tens  of 
feet,  about  $250,000. 

-  To  increase  the  target  acquisition  cone  in  the  guidance  sys¬ 
tem  of  a  short-range  air-to-air  missile,  about  $3000/10  deg. 

-  To  gain  the  range  increment  from  accurate  fire  of  a  missile 
rather  than  a  gun  on  a  tank,  the  cost  of  the  fire  control  sys¬ 
tem  increases  about  $100, 000/km  of  range. 

-  To  increase  the  accuracy  of  an  airborne  inertial  navigation 
system  by  an  order  of  magnitude,  about  $500,000. 

The  consequences  of  the  military  focus  on  performance  and  func¬ 
tional  capability  have  been  significant: 

1.  While  the  cost  per  active  electronic  element  has  decreased 

by  two  orders  of  magnitude  or  more  in  the  progression  from 
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vacuum  tubes  to  MOS,  the  growth  of  i  unctions  has  led  to  a 
net  increase  in  the  number  and  cost  of  system  parts.  Thus 
the  reliability  trend  for  electronic  systems  and  subsystems 
has  been  stationary  or  downward. 
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2.  To  counteract  the  downward  trend  in  system  reliability  oc¬ 
casioned  by  increased  complexity,  there  has  been  increased 
emphasis  on  parts  inspection,  test,  selection,  and  trace  - 
ability  at  a  substantial  cost  increment  to  the  military  over 
the  cost  of  equivalent  commercial  parts. 

3.  The  DOD  share  of  the  market  is  only  20  percent  and  is  de¬ 
clining  in  microelectronics  and  certain  other  areas  of  elec¬ 
tronics.  Where  military  needs  are  special — that  is,  where 
commercial  parts  are  not  used — DOD  must  pay  the  high  cost  of 
special  designs,  captive  or  dedicated  production  lines, 
small  production  runs,  and  special  quality-control  arrange¬ 
ments  . 

There  are  a  number  of  alternatives  available  to  the  military,  and 
they  will  be  discussed  in  more  detail  in  subsequent  chapters  of  this 
report.  The  fact  that  commercial  technology  is  turning  over  every  3 
to  5  years  in  microelectronics  and  certain  other  areas,  while  military 
development  takes  7  to  10  years  from  inception  to  inventory,  suggests 
that  some  portions  of  military  electronic  designs  are  obsolescent  by 
the  time  they  are  deployed. 

This,  in  turn,  suggests  the  alternative  that  the  military  permit 
utilization  of  more  commercial  parts  and  free  itself  from  dependence 
on  rigorous  military  specifications  that  demand  premium  and  perhaps 
outmoded  components.  To  do  so,  the  military  needs  to  depend  more  on 
specification  of  equipment  form,  fit,  function,  and  interface  and  less 
on  specification  of  detailed  designs.  By  so  doing,  the  military  may 
also  admit  more  modified  commercial  designs  to  military  competitive 
procurement.  It  may  also  be  desirable  to  provide  controlled  environ¬ 
ments  for  equipments  in  order  to  increase  the  utility  of  commercial 
components  and  equipments. 

Freedom  to  use  the  most  advanced  of  available  technology,  ac¬ 
companied  by  the  search  for  design  simplicity  implied  in  the  design- 
to-cost  approach^  and  the  evolution  of  reliability  through  use  of  the 
iterative  test-and-fix  process, ^  represent  a  method  of  utilizing 
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technology  in  military  electronics  that  represents  a  sharp  departure 
from  the  prior  approach  of  seeking  performance  regardless  of  cost  and 
reliability  outcomes.  The  use  of  specif ications  for  form,  fit,  and 
function  and  of  interface  standards  to  ensure  interchangeability  of 
competing  designs^  can  provide  a  greater  choice  of  equipment  for  DOD 
and  increased  incentives  for  suppliers  to  progress  toward  the  objec¬ 
tives  of  simplification,  reduced  cost,  and  increased  reliability. 

K.  THE  MILITARY  ELECTRONICS  LIFE-CYCLE  PROCESS:  A  MAJOR  FLAW  AND 
A  POSSIBLE  REMEDY 

We  must  learn  to  explore  all  the  options  and 
possibilities  that  confront  us  in  a  complex 
and  changing  world. 

--James  William  Fulbright 

Competition  is  a  pervasive  theme  that  has  emerged  in  this  and  sev 
eral  past  studies  of  systems  acquisition  management.  The  value  of 
competition  in  helping  to  keep  costs  down  and  in  maintaining  options 
appears  intuitively  self-evident.  Many  examples  of  cost  reduction 
through  competition  came  to  light  during  this  study.  However,  such 
data  are  largely  scattered  and,  in  many  cases,  anecdotal.  The  small 
amount  of  systematically  derived  quantitative  evidence  that  exists  to 
support  the  efficacy  of  competition  is  presented  and  discussed  later 
in  this  report.  For  the  rest,  the  qualitative  and  quantitative  evi¬ 
dence  has  been  taken  as  positively  suggestive  enough  to  warrant  build¬ 
ing  much  of  our  analysis  around  the  theme.  But  the  reader  should  bear 
in  mind  that  much  of  this  is  based  on  the  assumption,  yet  to  be  vali¬ 
dated  by  experience,  that  competition  throughout  the  electronic-system 
life-cycle  process  will,  on  the  whole,  yield  great  benefits  in  reduced 
cost,  greater  equipment  reliability,  and  availability  of  options  at 
critical  selection  points  in  that  process. 

As  shown  previously,  the  cost  and  reliability  problems  that  are 
increasingly  evident  in  military  electronics,  arising  in  large  meas¬ 
ure  from  the  disparity  in  magnitude  and  direction  of  development  and 
application  between  civilian  and  military  technology,  imply  that  the 
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POD  must  change  its  approach  to  acquiring  and  maintaining  electronic 
equipment.  The  sum  of  these  changes  would,  if  integrated  around  the 
them*'  oi  increasing  competition  at  all  stages  of  the  life  cycle,  be 
rel lectod  in  the  life  cycle  of  military  electronic  systems,  as  illus¬ 
trated  in  the  following  discussion. 

The  life-cycle  process  of  electronic  equipment  and  systems  can 
be  roughly  partitioned  into  tour  phases,  each  of  which  involves  one 

or  more  steps: 

1.  Requirements  and  acquisition  decisionmaking 

2.  Development 

3.  Production 

4.  Operation  and  maintenance. 

Ideally,  at  each  step,  there  should  exist 

-  Established  goals 

-  Goal-oriented  incentives 

-  Competing  alternative  courses  from  which  the  decisionmaker 
may  choose 

-  Visibility  of  the  consequences  of  each  course  of  action. 

It  has  become  apparent  in  this  study  that  at  most  of  the  steps 
comprised  in  the  life-cycle  process  for  military  electronics,  one  or 
another  of  these  elements  is  missing.  Of  the  missing  elements,  pos¬ 
sibly  the  most  consequential  is  the  lack  of  competing  alternatives, 
for  when  the  decisionmaker  has  a  choice  to  make,  he  will  be  driven  to 
research  the  goals,  incentives,  and  consequences  in  order  to  ration¬ 
alize  his  decision. 

Figure  II-6  illustrates  what  is  meant  by  a  paucity  of  alterna¬ 
tives  in  a  hypothetical  worst  case.  In  this  case,  after  statement  of 
a  mission  deficiency  and  generation  of  a  set  of  requirements,  a  pre¬ 
ferred  conceptual  solution  is  decided  upon  and  advocated,  while  alter¬ 
natives  are  discarded.  Performance  specifications  based  on  the  pre¬ 
ferred  concept  are  prepared,  and  a  design  competition  is  undertaken 
from  which  a  single  design  is  selected.  Design  offerings  that  do  not 
reflect  the  preferred  concept  are  rejected  as  "nonresponsive ."  The 
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selected  design  is  developed  to  completion,  perhaps  at  a  greater  cost 
and  in  a  longer  time  than  anticipated,  for  there  are  no  choices.  The 
first  production  is  necessarily  of  the  chosen  design,  even  though  it 
may  not  be  as  economical  in  meeting  the  mission  deficiency  as  other 
possible  designs.  Because  competing  designs  have  been  eliminated,  the 
second  production  is  identical  in  design  to  the  first  one,  although 
there  may  be  a  price  competition.  Finally,  the  deployed  equipment  is 
maintained  by  military  maintenance  organizations;  no  alternative  is 
considered,  although  some  may  be  possible. 

The  asterisks  in  Fig.  II-6  designate  steps  in  the  electronics 
life-cycle  process  where,  we  believe,  alternatives  could  usefully  be 
developed,  and  where  competition  among  concepts,  designs,  prices,  and 
suppliers  could  be  enhanced.  Subsequent  sections  of  this  report  will 
deal  in  detail  with  the  means  and  mechanisms  by  which  this  can  be  done, 
and  with  the  potential  value  of  doing  it.  Substantial  changes  in  re¬ 
quirements,  acquisition,  and  maintenance  practices  would  be  needed  to 
provide  these  means  and  mechanisms.  If  such  changes  were  made,  the 
hypothetical  process  shown  in  Fig.  II -6  could  take  on  the  form  of  Fig. 
II-7,  in  which  double  arrows  indicate  that  more  than  a  single  choice 
is  available  at  a  step. 

With  enhancement  of  alternatives,  as  shown  in  Fig.  II-7,  a  mis¬ 
sion  deficiency  would  trigger  the  generation  of  a  requirement.  A 
dollar  target,  a  schedule,  and  a  quantity  consistent  with  military 
priorities  and  available  funds  would  be  associated  with  the  require¬ 
ments  statement.  Alternative  solutions,  representing  both  product- 
improvement  and  new-generation  approaches,  would  be  compared  as  to 
cost  and  effectiveness;  at  least  one  of  each  kind  would  be  pursued 
whenever  feasible,  if  there  were  a  decision  to  proceed.  Approaches 
having  high  risk  would  be  set  aside,  and  the  high-risk  problems  would 
be  specifically  attacked  before  proceeding.  Performance  specifica¬ 
tions,  complete  with  interface  standards,  would  be  prepared  in  a  way 
that  would  assure  interchangeability  of  designs  developed  to  the 
specifications,  and  would  maintain  the  possibility  of  design  and  price 
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competition  in  subsequent  production.  After  contractor  design  com¬ 
petition,  at  least  two  designs  would  be  selected,  it  at  all  feasible, 
to  be  carried  through  development  to  the  prototype  stage.  Production 
cost  targets  would  be  included  as  design  parameters,  and  future  mainte¬ 
nance  warranty  requirements  would  be  stated,  where  appropriate  and 
workable.  A  subsequent  design  and  price  competition  would  determine 
which  designs  were  to  be  carried  into  first  production.  The  propor¬ 
tion  of  the  production  award  to  each  bidder  might  be  based  on  the 
relative  merits  of  the  designs  and  prices,  including  price  of  warranty, 
if  any;  in  some  cases  (e.g.,  few-of -a-kind  systems),  it  would  be  pref¬ 
erable  for  the  winner  to  take  all.  Suppliers  would  continue  improving 
design  and  reliability  to  prepare  for  competition  for  the  second  pro¬ 
duction  buy,  if  there  were  to  be  one,  or  to  meet  reliability  guaran¬ 
tees  and  improve  return  on  investment,  even  if  there  were  no  further 
production  buy.  Interchangeability  of  competing  designs  would  remain 
assured  by  virtue  of  compliance  with  the  interface  specifications. 
Finally,  upon  equipment  deployment,  maintenance  might  be  under  sup¬ 
plier  warranty,  or,  if  there  wert  no  warranty,  a  selection  might  be 
made  between  military  and  contract  maintenance  on  the  basis  of  com¬ 
parative  costs  and  convenience. 

The  process  just  described  implies  incorporation  of  several  im¬ 
portant  changes  in  the  philosophy  of  system  acquisition  and  mainte¬ 
nance.  The  changes  can  be  generalized  as  follows: 

1.  Conceptual,  design,  price,  and  supplier  alternatives  must  be 
made  visible  and  must  be  sustained  during  the  entire  process, 
from  requirements,  through  development  and  production,  to 
maintenance . 

2.  Goals,  particularly  those  of  cost  and  reliability,  would  be 
stated . 

3.  Incentives  for  improving  design  would  be  provided  by  con¬ 
tinuing  competition  between  interchangeable  designs.  In¬ 
centives  for  life-cycle  cost  reduction  would  be  provided 
wherever  possible  by  the  use  of  warranties  and  by  provision 
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for  alternatives  to  Government  maintenance.  Incentives  for 
reconciling  requirements,  technology,  and  costs  would  be 
provided  by  the  inclusion  of  cost  as  a  design  parameter. 

While  this  formulation  represents  an  approach  that  may  not  be 
achievable  for  all  equipments  or  systems  at  all  times,  the  results  of 
this  study  suggest  that  it  is  an  ideal  worth  striving  to  achieve ,  for 
large  potential  payoffs.  It  is  likely  to  be  more  achievable  for  elec¬ 
tronic  systems  and  subsystems  than  for  major  weapons  systems  as  a 
whole . 

L.  CONTENTS  OF  THE  REMAINDER  OF  THIS  REPORT 

Part  III,  immediately  following,  discusses  the  uncertainties  in 
the  two  metrics,  cost  and  reliability,  to  which  the  Electronics-X  Study 
was  addressed.  As  the  study  proceeded,  it  became  increasingly  clear 
that  the  major  findings  would  show  certain  key  types  of  data  to  be  vir¬ 
tually  nonexistent;  recommendations  to  remedy  this  situation  are  thus 
an  important  output  of  the  study.  The  absence  of  valid  quantitative 
information  on  past  results  in  the  areas  of  cost  and  reliability  makes 
difficult  the  validation  and  use  of  models  for  life-cycle  cost  estima¬ 
tion,  makes  impossible  even  the  loosest  cost-benefit  analysis  of  report 
recommendations,  and  prevents  measurement  of  any  changes  introduced 
into  practices,  policies,  and  procedures.  Recommendations  for  improved 
accounting  and  auditing  procedures  will  be  made. 

Other  findings  and  recommendations  can  be  classified  in  two  cate¬ 
gories:  (1)  those  based  upon  the  sketchy  and  imperfect  data  available, 

and  (2)  those  that  could  be  assembled  from  qualitative,  logical  anal¬ 
ysis  circumventing  the  unavailability  of  data.  First,  in  Part  III,  the 
electronics  life-cycle  process  is  discussed  according  to  its  phases: 
requirements,  design  and  development,  production,  and  maintenance.  In 
each  phase,  some  techniques  are  recommended  by  which  electronics  costs 
can  be  held  down  and  reliability  improved.  The  discussion  concentrates 
on  the  key  issues  and  the  major  ideas  for  resolving  them  that  emerged 
from  this  study. 
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In  Part  IV,  specific  attention  is  given  to  the  details  of  salient 
subjects  referred  to  in  Part  III:  warranties,  standardization,  soft¬ 
ware,  configuration  management,  and  project  management. 

The  reader  will  recognize  that  there  are  no  firm  dividing  lines 
between  the  ideas  addressed  in  connection  with  each  phase  of  the  life 
cycle,  or  between  the  issues  discussed  in  detail  as  special  topics. 

The  impact  of  actions  in  the  requirements  process  is  felt  during  de¬ 
velopment,  production,  and  maintenance;  design  to  cost  has  implica¬ 
tions  appearing  at  all  phases  of  the  life  cycle;  the  issues  addressed 
as  special  topics  interact  with  each  other  and  affect  equipment  through¬ 
out  its  life  cycle.  Thus,  divisions  have  been  made  in  the  interest 
of  clarity  in  presenting  ideas  in  some  logical  order.  Interactions 
and  overlaps  of  ideas  will  be  readily  apparent  as  the  presentation 
unfolds. 
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III.  ACQUISITION  AND  SUPPORT 

A.  UNCERTAINTIES  IN  COST  AND  RELIABILITY 

The  Electronics-X  Study  was  aimed  at  finding  methods  of  reducing 
the  cost  and  improving  the  reliability  of  military  electronics.  Sub¬ 
sequent  sections  of  this  report  deal  with  various  possibilities,  for 
example:  in  the  requirements  process,  associating  a  predicted  cost 

with  a  military  need;  in  design,  designing  to  a  specified  unit  pro¬ 
duction  cost  and  to  a  mission-dictated  yet  attainable  reliability; 
and  in  maintenance,  using  alternatives  to  Government  maintenance. 

The  suggestion  that  methods  of  reducing  cost  and  improving 
reliability  can  be  found  seems  to  carry  with  it  the  twin  implications 
that  currently  realized  cost  and  reliability  are  known  and  that  cost 
and  reliability  are  predictable,  neither  of  which  is  strictly  true. 

It  is  possible,  in  principle,  to  measure  the  cost  of  development 
and  production  of  an  item  by  suitably  aggregating  contract  costs. 
Prediction  of  program  costs,  however,  has  been  inaccurate ,  to  say  the 
least. 

Measurement  of  electronics  maintenance  costs,  either  by  item  or 
in  the  aggregate,  has  never  been  systematically  undertaken,  even 
though  these  costs,  whether  considered  on  an  annual  basis  or  over  the 
life  cycle  of  equipment,  are  of  the  same  importance  as  procurement 
costs.  Prediction  of  maintenance  costs  has  been  made  the  subject  of 
numerous  life-cycle  models,  but  the  absence  of  current  data  militates 
against  either  providing  input  parameters  to  a  model  or  validating 
the  predictions. 

Measurement  of  reliability  is  undertaken  in  the  factory  or  labora¬ 
tory  for  much  military  electronics,  but  despite  considerable  attention 
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to  the  reporting  of  maintenance  actions,  systematic  evaluation  of 
reliability  attained  in  the  field  is  extremely  difficult  and  usually 
is  not  accomplished.  Prediction  of  reliability  is  frequently  under¬ 
taken  by  equipment  designers  on  the  basis  of  aggregation  of  the 
anticipated  failure  rates  of  pieces  and  parts,  but  the  predicted 
values  thus  obtained  disagree  by  large  factors  with  the  values 
actually  measured  in  the  factory  or  reported  from  the  field. 

The  following  sections  discuss  inadequacies  in  measuring  and 
predicting  the  cost  and  reliability  of  military  electronics  and  recom¬ 
mend  steps  to  remedy  those  inadequacies.  A  related  subject,  that  of 
schedule  prediction,  is  discussed  briefly. 

1.  Cost-Estimating  Uncertainties 

One  of  the  many  critical  areas  that  must  be  addressed  if  the  cost 
of  military  electronics  is  to  be  reduced  is  the  uncertainty  in  the 
present  DOD  ability  to  estimate  the  ultimate  program  costs  associated 
with  the  acquisition  and  operation  of  electronics.  These  costs  in¬ 
clude  the  total  program  costs  attributable  to  a  new  product  or  weapon 
system,  including  development,  production,  installation,  and  field 
operation  and  maintenance  costs,  whether  incurred  by  Government  or 
industry . 

Uncertainties  in  cost  estimation  have  become  critical  considera¬ 
tions  under  conditions  of  cost  constraints  on  acquisitions  and  total 
program  budgets.  Adequate  cost  prediction  capability  is  essential  to 
making  rational  choices  among  alternative  programs.  Moreover,  if  the 
design- to-cost  concept  is  to  be  successfully  implemented  by  the  DOD, 
realistic  cost  goals  must  be  set,  and  uncertainties  associated  with 
those  cost  goals  must  be  recognized,  quantified,  and  reduced,  if  pos¬ 
sible.  Failure  to  improve  electronics  cost  estimation  will  surely 
result  in  continued  unexpected  cost  growth  like  that  experienced  to 
date. 

a.  Cost  Growth  in  Acquisitions  of  Major  Systems.  The  most  con¬ 
sistent  evidence  of  widespread  inability  to  estimate  equipment 
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acquisition  costs  has  been  the  continuing  cost  growth  of  major  weapons 
systems.  Although  evidence  of  cost-estin sting  uncertainties  as  exem¬ 
plified  by  cost  growth  has  always  been  available,  the  establishment  in 
1968  of  Selected  Acquisition  Reports  (SARs)  for  major  systems  provided 
recurring  and  more  consistent  cost-estimating  information  that  docu¬ 
mented  the  cost  growth  of  those  systems.  In  .1971,  the  SAR  reporting 
system  was  amended  to  include  information  relevant  to  the  causes  for 
cost  growth  in  addition  to  the  actual  revised  estimates.  This  infor¬ 
mation  provided  by  the  SAR  has  made  for  increased  visibility  of  the 
aggregate  problems  of  cost  growth  and  cost-estimating  uncertainty.* 

The  SAR  reporting  system  is  built  around  three  estimates  of 
total  program  cost — a  planning  estimate,  a  development  estimate,  and 
a  current  estimate.  The  cost  growth  reflected  in  a  comparison  of  these 
three  estimates  can  vary  considerably,  depending  on  the  relative  tim¬ 
ing  of  the  estimates  in  the  planning,  development,  and  production 
phases  of  a  program.  As  a  program  proceeds  beyond  DSARC  II  into  full- 
scale  development,  the  current  estimate  is  periodically  adjusted  on 
the  basis  of  experience  and  new  projections  of  unit  production  cost 
and  quantity.  At  DSARC  III,  initiation  of  full-scale  production,  the 
current  estimate  reflects  actual  expenditures  incurred  during  develop¬ 
ment  and  the  most  recent  estimate  of  total  production  cost.  In  theory, 
at  least,  the  current  estimate,  as  periodically  compiled  throughout 
development  and  production,  will  converge  toward  the  total  program 
cost  at  program  completion.  Comparison  of  planning,  development,  and 
current  estimates  is,  therefore,  likely  to  be  valid  as  an  indicator 
of  cost  growth  only  if  the  estimates  have  been  made  at  comparable  times 
in  the  planning,  development,  and  production  phases  of  a  program. 


Cost  growth  as  shown  in  successive  estimates  during  acquisi¬ 
tions  of  major  weapons  systems  during  the  past  5  fiscal  years,  1969- 
1973,  is  summarized  in  Table  III-l,  based  on  SAR  data  compiled  by  the 


*The  SAR  system  is  not  a  unique  reporting  system.  Previous  reporting 
systems  such  as  the  Cost  Information  Report  (CIR)  presented  much  ot 
the  same  data,  and  a  new  reporting  system,  the  Contractor  Cost  Data 
Report  (CCDR),  will  expand  the  cost  data  base  and  coverage. 
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General  Accounting  Office  (GAO).^  It  is  seen  that  the  average  cost 
growth  from  the  planning  estimate  to  the  development  estimate  and 
from  the  development  estimate  to  the  current  estimate  has  remained 
nearly  constant.  For  the  5-year  period,  the  average  ratio  of  devel¬ 
opment  estimate  to  planning  estimate  was  1.18,  and  the  average  ratio 
of  current  estimate  to  development  estimate  was  1.19.  Although  less 
cost  growth  is  shown  for  some  years  than  for  others,  the  aggregate 
cost  growth  for  the  5  years,  represented  by  an  average  1.40  ratio  of 
current  estimate  to  planning  estimate,  indicates  that  little  signifi¬ 
cant  progress  is  being  achieved  in  reducing  cost  growth. 

TABLE  III-l.  SUMMARY  OF  COST  GROWTH  REPORTED  IN  ACQUISITIONS 
OF  MAJOR  SYSTEMS3 


Fiscal  Year 


1969 

1970 

1971 

1972 

1973d 

Averaae 

Total  Number  of  Systems 
Reported 

57° 

61 

77 

45 

45 

57 

Ratio  of  Development 
Estimate  to  Planning 
Estimate 

1.19 

1.15 

1.16 

1.15 

1.25 

1.18 

Ratio  of  Current  Esti¬ 
mate  to  Development 
Estimate 

1.26 

1.22 

1.12 

1.20 

1.14 

1.19 

Ratio  of  Current  Esti¬ 
mate  to  Planning 
Estimate 

1.50 

1.40 

1.31 

1.39 

1.43 

1.40 

aData  source:  Ref.  1;  each  system  is  assigned  equal  weight  in  this 
table . 

^Data  are  from  the  December  31,  1972  reports,  Ref.  1. 

cCost  growth  data  available  for  only  38  of  the  57  systems  reported. 
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Further  analysis  of  the  GAO  SAR  data  can  provide  additional 
insight  into  both  the  magnitude  and  the  time  relationship  of  cost 
growth  as  a  program  progresses  through  the  development  and  production 
phases . 

Among  the  96  weapon-system  programs  reported  by  SARs  during 
the  4-year  period  from  FY  1969  through  FY  1972,  a  survey  of  programs 
involving  substantial  amounts  of  electronics  revealed  annual  current 
cost  estimates  for  16  programs  during  development  (Table  III-2)  and 
18  programs  during  production  (Table  III -3)  that  were  suitable  for 
analysis.  Three  programs  (TOW,  VAST-247,  and  Mark  48)  appeared  in 
both  the  development  and  production  groups.  In  addition  to  the  cur¬ 
rent  cost  estimates,  Tables  III -2  and  III -3  show  the  reported  plan¬ 
ning  and  development  cost  estimates  for  the  programs.  The  tables  sum¬ 
marize  program  cost  growth  as  a  percentage  of  the  earliest  available 
estimate.  Generally,  the  cost  growth  of  an  individual  program  has 
been  measured  from  the  planning  estimate;  otherwise,  in  the  absence 
of  a  planning  estimate,  growth  has  been  measured  from  the  develop¬ 
ment  estimate. 

The  summary  data  in  Tables  III- 2  and  III- 3  are  the  basis 
for  the  trend  lines  in  Figs.  III-l  and  III-2  (page  86),  respectively, 
which  indicate  the  course  of  the  growth  with  time  of  the  average 
program  cost  of  the  weapons  systems  during  development  and  production. 

For  the  programs  in  Table  III- 2  and  in  Table  III- 3  for  which 
planning  estimates  were  available,  the  weighted  average*  growths  of 
total  program  cost  from  planning  estimate  to  development  estimate  were 
24  percent  and  32  percent,  respectively.  For  those  programs  beyond 
DSARC  II  and  in  full-scale  development  (Table  III-2),  the  weighted 
average  growth  of  total  program  cost  rose  from  22  percent  in  the 
first  reported  year  of  development  to  43  percent  in  the  fourth  year. 
For  those  programs  in  the  production  phase  (Table  III- 3),  the  weighted 

The  weight  assigned  to  each  program  was  proportional  to  the  initial 
estimate  of  total  program  cost.  See  Appendix  F  for  details  of  the 
weighting  method. 
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TABLE  III -2.  SUMMARY  OF  GROWTH  OF  TOTAL  PROGRAM  COST  OF  SELECTED  PROGRAMS  DURING  DEVELOPMENT' 
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Source  of  data:  Ref.  1. 

Vor  notes  on  method  of  computation  and  weighting,  see  Appendix  F. 

Cost  growth  over  earliest  available  estimate  (planning  estimate,  if  reported;  otherwise,  development  estimate). 
Lack  of  planning  estimate  results  from  late  SfiR  reporting  requirement. 
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average  growth  of  total  program  cost  rose  from  65  percent  in  the 
first  reported  year  of  production  to  87  percent  in  the  fourth  year. 

From  Table  III- 3  it  is  thus  seen  that  the  growth  of  the 
estimated  total  program  cost  from  the  conceptual  or  planning  stage  to 
a  year  of  stable  production  (or  to  termination)  was  87  percent  on 
the  average.*  A  number  of  adjustments  to  the  cost  estimates  for 
individual  programs  had  usually  taken  place  throughout  the  programs 
in  attempts  to  bring  the  estimates  into  line  with  budgetary  realities. 

b.  Cost  Growth  and  Cost- Estimating  Deficiencies.  Cost  growth 
is  not  a  perfect  indicator  or  measure  of  the  success  of  program  cost 
estimates,  because  the  many  changes  that  occur  during  an  average  pro¬ 
gram  change  the  basis  upon  which  the  original  cost  estimate  was  made. 
These  changes  often  involve  weapon- system  performance  requirements, 
program  schedule,  and  production  quantity.  In  1970,  the  SAR  was 
amended  to  identify  the  cost  effects  of  these  alterations  in  program, 
as  well  as  other  causes  for  program  cost  change.  Additional  reasons 
given  for  revision  of  cost  estimates  include  support  item  changes, 
economic  changes,  "unpredictable"  changes,  and  "estimating"  changes. 
The  effects  of  each  have  been  reported  in  the  SAR  since  1970. 

The  GAO  has  examined  the  causes  of  program  cost  variance  by 
three  major  categories:  changes  in  requirements,  errors  in  estima¬ 
tion,  and  economic  changes.  Data  from  the  GAO  analyses  for  FY  1970 
through  FY  1972,  as  shown  in  Table  III-4,  indicate  that  changes  in 
program  scope  and  requirements  accounted  for  45  percent  of  the  total 
growth  in  program  cost  in  FY  1972,  while  estimating  errors  accounted 
for  25  percent  and  inflation  for  30  percent.  It  is  observed  that  the 
table  indicates  reductions  in  the  percentages  of  total  cost  growth 
attributed  to  estimating  errors  and  to  changes  in  program  and  require¬ 
ments  during  the  three-year  reporting  period.  However,  the  percentage 
of  cost  growth  attributed  to  economic  changes  increased  by  58  percent 

# 

The  weight  assigned  to  each  program  was  proportional  to  the  initial 
estimate  of  total  program  cost.  See  Appendix  F  for  details  of  the 
weighting  method. 
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(from  19  percent  in  FY  1970  to  30  percent  in  FY  1972),  preventing  much 
improvement  in  total  cost-estimating  performance. 


TABLE  III -4.  SUMMARY  OF  SAR  DATA  ON  FPOGRAM  COST  GROWTH9 
(dollars  in  billions) 


Fiscal  Year 


1970 

1971 

1972 

Total  Number  of  Systems 

61 

77 

45 

Total  Estimated 

Cost  Growth 

$21.6 

$18.7 

$19.1 

Cost  Growth  Due 
Percentage  of 

to  Economic  Changes 

Total  Cost  Growth 

$  4.0 
19% 

$  4.2 
22% 

$  5.7 
30% 

Cost  Growth  Due 
Percentage  of 

to  Estimating  Errors 

Total  Cost  Growth 

$  6.2 
29% 

$  5.5 
29% 

$  4.8 
25% 

Cost  Growth  Due 
Requirements 
Percentage  of 

to  Changes  in  Program  & 

Total  Cost  Growth 

$11.4 

52% 

$  9.0 
49% 

$  8.6 
45% 

aSource:  Ref.  1. 


c.  Cost  Growth  in  Electronics  Acquisition.  While  cost  experience 
with  major  weapons  systems  has  been  documented  through  the  project 
reporting  systems ,  comparable  data  on  the  program  costs  of  electronic 
equipment  and  subsystems  have  not  been  extensively  documented  and 
analyzed.  One  of  the  few  studies  of  program  cost  experience  in 

2 

electronics  has  been  a  study  by  the  Army  Procurement  Research  Office 
in  which  193  electronics  prime  contracts  were  analyzed  as  part  of  a 
total  statistical  sample  of  740  contracts  for  all  types  of  Army  com¬ 
modities. 

The  results  of  the  Army  study  show  that  electronics  contracts 
have  experienced  cost  growth  comparable  to  that  of  major  weapons 
systems.  The  data  indicate  that  much  of  the  documented  growth  can  be 
attributed  to  changes  in  contract  content  or  scope.  Table  III -5  sum¬ 
marizes  the  cost  growth  in  electronics  contracts  documented  by  the 
Army  study. 
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TABLE  III- 5.  COST  GROWTH  IN  ARMY  ACQUISITIONS  OF  ELECTRONICS 
AND  ALL  TYPES  OF  COMMODITIES8 


Research 

& 

Development 


Procurement 


Total 

Acquisition 

Program 


Number 

% 

Number 

% 

Number 

% 

of 

Cost 

of 

Cost 

of 

Cost 

Commodity 

Contracts 

Growth 

b 

Contracts 

Growth 

c 

Contracts 

Growth 

d 

Electronics 

68 

165% 

125 

137% 

193 

147% 

All  Types 

236 

257% 

504 

108% 

740 

156% 

aSource:  Ref.  2 
^Standard  deviation  287%. 


cStandard  deviation  306%. 
dStandard  deviation  229%. 


Although  the  statistics  available  on  electronics  cost  growth 
are  sparse,  evidence  documented  to  date  supports  the  belief  that 
acquisition  of  electronic  equipment  and  subsystems  is  subject  to  the 
same  cost  uncertainties  as  acquisition  of  major  weapons  systems  and 
possibly  to  some  additional  cost  uncertainties  caused  by  rapid  ad¬ 
vances  in  electronics  technology.  Thus,  the  cost  growth  of  electronics 
resulting  from  uncertainties  in  estimating  the  scope  of  work,  varying 
economic  conditions,  and  changing  requirements  is  not  less  than  the 
cost  growth  of  major  weapons  systems.  The  average  cost  growth  of 
major  systems  at  the  completion  of  development  and  production  is  con¬ 
tained  within  the  uncertainty  bandwidth  of  the  Army’s  estimates 
(Table  III- 5)  for  electronics. 

d.  Cost  G-owth  and  Uncertainty  in  Cost  Estimation.  The  concept 
of  cost -estimating  uncertainty  and  realized  program  cost  experience 
can  be  explored  quantitatively  if  estimating  uncertainty  is  defined  to 
include  uncertainty  in  all  the  factors  that  will  ultimately  influence 
the  total  program  cost.  Cost  growth  data  then  become  an  empirical 
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measure  of  documented  ability  to  estimate  ultimate  program  cost  at 
periodic  stages  in  a  program. 

To  illustrate  the  uncertainty  in  estimates  for  major  weapons 
systems ,  cost  data  reported  by  the  SARs  and  the  GAO  have  been  analyzed . 
As  shown  in  Fig.  III-l,  covering  development,  the  ratio  of  the  current 
estimate  tc  the  initial  estimate  of  total  program  cost  starts  from 
unity  (zero  uncertainty)  at  the  planning  stage  and  becomes  1.43  ±  0.96 
at  DSARC  III.  For  the  programs  that  go  on  to  production  (Fig.  Ill- 2), 
this  ratio  is  1.87  ±  0.35  at  the  fourth  year  of  production  (or 
termination) . 

The  demonstrated  uncertainties  in  estimating  future  program 
costs  agree  with  studies  by  the  Rand  Corporation  that  show  the 
estimating  uncertainty  associated  with  equipment  cost  estimates  to  be 
of  the  order  of  20  to  25  percent  about  the  mean  estimate.  Rand  also 
indicates  that  the  estimated  operating  cost  of  avionics  can  be  expected 
to  increase  by  a  factor  of  10  between  DSARC  II  and  DSARC  III.3  Using 
the  life-cycle  cost  model  of  the  Air  Force  Logistics  Command  and  pro¬ 
gram  cost  data  on  the  Litton  N-16  inertial  platform,  Rand  demonstrates 
that  predictions  of  program  10-year  support  cost  increased  from  $14.7 
million  to  $131.6  million  between  DSARC  II  and  DSARC  III,  and  that 
the  standard  deviation  about  the  mean  decreased  from  25  percent  to 
19  percent  (Table  III- 6). 

TABLE  III-6.  10-YEAR  SUPPORT-COST  ESTIMATES  AND  UNCERTAINTIES, 
LITTON  N-16  INERTIAL  PLATFORM3 

(dollars  in  millions) 


^  At  Initiation 

of  Development 

Estimate  $14,727  ±  3.750 

Standard  Deviation  ±25% 


Well  into  OTS-E 

$131,565  ±  25.515 
±19% 


aSource:  Ref.  3. 
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DSARC  II  DSARC  III 


FIGURE  Uhl .  Ratio  of  Current  Estimate  of  Total  Program  Cost  During  Development 
to  Initial  btimate  of  Total  Program  Cost 


DSARC  II  DSARC  III 


FIGURE  111-2.  Ratio  of  Current  Estimate  of  Total  Program  Cost  During  Production 
to  Initial  Estimate  of  Total  Program  Cost 


Hi 


I 


t 


) 


*r 


e 


✓ 


r 


j 


t 


j 


r 

»> 

£ 


i 


f 


I 


A 


r 


► 


.*»■■ 


V 


& 


fc 


► 


:> 


► 

* 

» 

* 


The  significance  of  these  and  similar  parallel  studies  is 
that  empirical  cost  experience,  both  with  major  weapons  systems  and 
with  electronic  subsystems,  clearly  demon~trates  that  early  cost 
estimates  have  been  uniformly  understated  and,  while  the  uncertainty 
surrounding  the  estimate  improved  in  absolute  value  as  the  programs 
proceeded  into  production,  unexpected  cost  growth  and  the  attendant 
estimating  uncertainties  have  continued  even  throughout  later  stages 
of  the  production  process. 

The  implications  of  these  empirical  and  theoretical  analyses 
are  critically  important  in  the  cost-constrained  acquisition  and 
deployment  of  weapons  systems.  If  weapons  systems  must  be  developed 
and  produced  to  a  fixed  unit  cost,  and  if  life-cycle  costs  must  be 
held  to  limits  compatible  with  overall  force-mix  budgets,  then  an 
estimating  methodology  and  resultant  cost  estimates  must  be  developed 
that  will  better  predict  ultimate  program  cost. 

2 .  Cost  Categories  and  Cost  Elements 

Two  sources  of  uncertainty  in  electronics  costs  are  (1)  diffi¬ 
culties  in  determining  the  full  costs  to  be  assigned  to  electronic 
systems,  subsystems,  and  equipments  and  (2)  the  impossibility  of 
comparing  either  aggregate  or  ingredient  costs  of  similar  systems. 

The  cause  of  these  difficulties  is  tracer  e  to  the  assignment  of  costs 
to  inconsistent  or  noncomparable  cost  categories. 

Recognition  of  these  problems  became  widespread  during  th«  late 
1960s,  when  comparable  cost  data  on  major  weapons  systems  could  not 
be  obtained  for  use  in  cost-benefit  studies  or  systems  analyses.  As 
a  result,  standard  contract  work  breakdown  structures  (WPSs)  were 
promulgated  in  MIL  STD  881,  and  a  standardized  cost  reporting  system 
based  on  the  Cost  Information  Report  (CIR)  was  established  by  OSD. 

Since  then,  additional  guidance  has  been  furnished  by  the  Service 
procurement  commands,  and  additional  cost  reporting  systems  have  been 
created  to  supersede  and  supplement  the  CIR  system.  In  1973,  the  most 
comprehensive  cost  data  reporting  system  to  date,  based  on  the 
Contractor  Cost  Data  Report  (CCDR),  was  proposed.  Standard  cost 
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categories,  as  shown  in  Table  III- 7,  were  also  established,  linking 
the  life-cycle  phases,  appropriation  categories,  and  work  breakdown 
elements  to  weapon-system  cost  definitions. 

TABLE  III- 7.  JOINT  LOGISTICS  CCMMANDERS  *  COST- DEFINITION  STRUCTURE 


W««pon-SystM  Cost 
Procur*»«nr 

PrcgrM  Acquisition  CcSt1* 
Lilt-cydi  ‘osr 


1 

LXt«*-'V  l*1  Fh«»sr  ’ 

vjUJji  ior 

Erigirwriu.! 
Jirve  U-p*r»-  : 

S  rixlu  •  i  r. 

T****’  U'f 

T 

1 

.  .  '  .  J 

1 

Pu.1  .u 

1 . 

HI  ».r  I  1  r  I.i*m 


Despite  these  attempts  to  organize  and  record  the  costs  incurred 
during  weapon-system  acquisition,  the  cost  elements  and  cost  categor¬ 
ies  do  not  always  provide  the  level  of  detail  or  the  focus  needed  to 
ascertain  costs  peculiar  to  electronics.  Thus,  while  MIL  STD  881 
specifies  a  structure  for  an  electronic- system  work  breakdown,  as 
shown  in  Table  III-8,  the  definition  of  electronic  system  in  MIL  STD 
881  excludes  electronics  "peculiar  to  or  closely  identified  with" 
another  type  of  system.  Electronic  subsystems  or  components  are 
therefore  often  submerged  in  weapon-system  WBSs,  and  their  costs  are 
not  reported  in  detail. 

Even  when  electronics  represents  a  major  system  or  equipment  that 
can  be  assigned  to  a  Level  1  WBS  (Table  III-8),  costs  incurred  during 
acquisition  may  be  variously  categorized.  The  terms  "hardware  cost," 
"flyaway  cost,"  "production  cost,"  "weapon- system  cost,"  and  "procure¬ 
ment  cost"  all  have  similar  connotations,  but,  as  Table  III-7  suggests, 
the  costs  associated  with  these  categories  can  vary  widely  in  content. 
The  fact  that  this  source  of  ambiguity  persists  will  be  demonstrated 
when  the  specified  cost  to  be  "designed  to"  in  the  electronics  design- 
to-cost  experiments  is  discussed  in  Section  III-C-4. 
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TABLE  III-8.  NUMMARY  WORK  BREAKDOWN  STRUCTURE:  ELECTRONIC 
SYSTEMS3 


Level  1  Level  2 

Electronic  System  Prime  Mission 

Product 


Training 

Peculiar  Support 
Equipment 

Systems  Test  and 
Evaluation 


System/Project 

Management 

Data 


Ope  ra  t iona 1/S i te 
Activation 


Common  Support 
Equipment 

Industrial 

Facilities 

Initial  Spares 
&  Repair 
Parts 


Level  3 

Integration  &  Assembly /Sensors/ 
Communications/Automatic  Data 
Processing  Equipment/Computer 
Programs/Data  Displays/Auxiliary 
Equipment 

Equipment/Services/Facilities 

Organizational- Intermediate  (In¬ 
cluding  Equipment  Common  to  Depot)/ 
Depot  (Only) 

Development  Tests/Technical  Eval¬ 
uation/Operational  Evaluation/ 
Mockups/Test  S  Evaluation  Support/ 
Test  Facilities 

Systems  Engineering  Management- 
Systems  Engineering/Supporting 
Project  Management  Activities 

Technical  Orders  &  Manuals/Engi¬ 
neering  Data/Management  Data/ 

Data  Depository 

Contractor  Technical  Support/Site 
Construction/Sire-Ship-Vehicle 
Conversion/System  Assembly,  In¬ 
stallation,  and  Checkout  on  Site 

Organizational-Intermediate  (In¬ 
cluding  Equipment  Common  to  Depot)/ 
Depot  (Only) 

Construction -Conversion -Expans ion/ 
Equipment  Acquisition  or  Moderniza- 
t ion/Ma inte  nance 

(Specify  by  allowance  list, 
grouping,  or  hardware  element.) 


dSource:  MIL  STD  881. 
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The  retrieval  of  cost  data  describing  all  the  costs  expended 
or  allocated  to  an  electronic  system  either  during  acquisition 
(RDT&E  and  Investment)  or  over  the  system  life  cycle  has  been  hin¬ 
dered  by  the  inconsistency  and  unavailability  of  comparable  cost- 
element  data.  As  discussed  in  Appendix  B,  in-house  expenditures 
totaling  $5.4  billion  are  estimated  for  Government  support  of  elec¬ 
tronic  equipment  in  the  appropriations  categories  of  research  and 
development,  procurement,  and  operations  and  maintenance  during 
FY  1974.  But,  although  these  expenditures  represent  approximately 
40  percent  of  the  total  Government  electronics  expenditures,  there 
is  no  set  of  cost  elements  and  assigned  costs  that  can  be  compared 
to  the  cost  information  available  from  industrial  contractors.  For 
example,  the  indirect  cost  categories  specified  for  contractor  re¬ 
porting  under  the  CCDR  format  include  the  12  indirect  cost  categor¬ 
ies  shown  in  Table  III- 9.  Nowhere  are  Government  indirect  costs 
allocated  to  specific  weapons  systems  or  contractual  efforts  at 
the  same  level  of  detail  so  that  the  full  costs  of  acquisition  and 
operations  can  be  determined. 

3 .  Cost  Reporting  Systems 

A  second  major  area  contributing  to  uncertainty  in  measurement 
of  the  costs  of  electronic  systems  and  equipment  is  that  of  cost 
reporting  systems.  Augmenting  the  contract  and  program  financial 
records  of  a  procurement  or  project,  cost  reports  are  designed  to 
furnish  the  DOD  decisionmaker  with  data  on  product  and  program  costs 
necessary  to  ascertain  a  project’s  financial  status  and  to  anticipate 
its  future  costs.  These  reports  are  also  to  serve  as  historical 
records  of  the  actual  costs  incurred  during  the  program. 

An  examination  of  the  major  reporting  systems  within  the  DOD 
reveals  that,  until  the  creation  of  the  Contractor  Cost  Data  Report 
(CCDR),  major  gaps  existed  in  the  coverage  of  the  standard  reporting 
system  during  systems  and  equipment  acquisition.  As  shown  in 
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TABLE  III -9.  SUMMARY  OF  INDIRECT  COST  CATEGORIES 


a .  Indirect  Labor 

HI  Salaries/Wages 

(2)  Supplemental  Allowances 

(3)  Apprentice  and  OJT 

(4)  Administrative  and 
Supervision 

(5)  Other 

b .  Employee  Benefits 

(1)  Paid  Absences 

(2)  Employee  Insurance 

(3)  Savings --Retirement 
Plans 

(4)  Education 

(5)  Other  Benefits 

c.  Payroll  Taxes 

(1)  FICA 

(2)  Federal  and  State 
Unemployment 

(3)  Composite  Payroll  Taxes 

(4)  Other 

d .  Employment 

(T)  Employment  Advertising 

(2)  Recruitment  Travel 

(3)  Employee  Relocation 

(4)  Composite  Employment 

(5)  Other 

e .  Communication/Travel 

(T)  Telephone  and  Tele  graph 

(2)  Postage 

(3)  Travel 

(4)  Corporate  Aircraft 

(5)  Other 

f .  Production  Related 

(Tj  Expendable  Tools  and 
Equipment 

(2)  Freight 

(3)  Material  Handling 

(4)  Manufacturing  Supplies/ 
Services 

(5)  Product  Servicing 

(6)  Tool  Handling 

(7)  Medical  Services 

(8)  Other 


g.  Facilities — Build inq/Land 

(1)  Depreciation  and 
Amortization 

(2)  Rentals 

(3)  Maintenance 

(4)  Insurance 

(5)  Utilities 

(6)  Property  Taxes 

(7)  Plant  Rearrangement 

(8)  Plant  Security 

(9)  Other 

h.  Facilities — Furniture /Equipment 

( 1) )  Depreciation  and 

Amortization 

(2)  Rentals 

(3)  Maintenance 

(4)  Data  Processing  Services 

(5)  Other 

i.  Administration 

(1)  Office  Supplies 

(2)  Reproduction/Engineering 
Supplies 

(3)  Professional  Services 

(4)  Contributions 

(5)  Other  Taxes 

(6)  Dues,  Memberships  and 
Subscriptions 

(7)  Conventions  and  Meetings 

(8)  Office  Services 

( 9 )  Other 

j .  Future  Business 

(iy  Bid  and  Proposal 

(2)  Independent  Research  and 
Development 

(3)  Advertising 

(4)  Other  Promotions 

k.  Other  Miscellaneous 

(T)  Assessments  and  Transfers 

(2)  Employee  Awards 

(3)  Corporate  Allocations 

(4)  Patents  and  Royalties 

(5)  Other 

l.  Credits 

( 1)  Services  to  other  Divisions 

(2)  Cash  Discounts 

( 3)  Other  Credits 
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Table  III- 10,  coverage  of  maintenance  costs  is  quite  incomplete, 
despite  Service  attempts  to  comply  with  DOD  directives  for  uniform 
cost  accounting.  Thus,  the  generalized  finding  is  that  the  full 
costs  of  acquisition  and  maintenance  are  inadequately  reported  by 
the  existing  reporting  systems.  That  is,  a  "single- thread”  analysis 
by  weapon  system  or  equipment  of  full  life-cycle  cost  is  not  pres¬ 
ently  possible  by  using  the  reported  information. 

The  stipulation  that  the  required  information  be  reported  is 
probably  inadequate,  as  the  present  contract  data  demonstrate.  Even 
when  detailed  reporting  systems  are  imposed,  the  data  that  are  col¬ 
lected  have  often  been  found  to  be  incomplete,  inconsistent,  and 
ambiguous.  As  a  recent  study  of  naval  avionics  cost  data  concluded, 
the  data  collection  system  for  contract  costs  did  not  provide  an 
adequate  basis  for  cost  analysis  or  cost  prediction,  despite  the  fact 

that  the  contractual  records  were  the  most  detailed  and  comprehensive 

4 

records  available. 

Therefore,  it  is  insufficient  just  to  design  and  promulgate  a 
system  directing  that  the  proper  costs  be  recorded.  Such  a  system 
must  be  subjected  to  periodic  validation  or  self -checking  to  ensure 
that  its  output  is  valid  and  comparable.  Equally  important,  the  data 
produced  by  such  a  reporting  system  must  be  catalogued,  stored,  and 
made  accessible  to  the  cost  analysis  community. 

a.  Finding.  Throughout  the  Electronics-X  Study,  we  have  en¬ 
countered  a  profound  lack  of  valid  cost  data  and  overwhelming  in¬ 
adequacies  in  the  pertinent  reporting  systems.  More  specifically: 


•  DOD  appears  to  have  no  cost  accounting  system  capable  of 
providing  data  on  the  full  life-cycle  costs  of  any  elec¬ 
tronic  subsystem.  Full  life -cycle  costs  include  RDT&E , 
Procurement,  O&M,  Military  Personnel  costs,  other  direct 
costs,  allocable  indirect  costs,  and  depreciation  or 
other  measure  of  capital  investment  in  support  equip¬ 
ment  and  facilities.  Maintenance  costs  and  indirect 
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Cost  Information  Report 
(CIR) 


Contractor  Cost  Data  Report 
( CCDR) 
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costs,  in  particular,  are  very  inadequately  known  from 
a  cost  accounting  point  of  view.  Moreover,  there  is 
often  confusion  as  to  the  significance  of  the  various 
reported  costs  because  of  inadequate  or  nonuniform 
definition  of  cost  elements.  As  a  result,  cost  estima¬ 
tion  and  cost-effectiveness  tradeoffs  are  difficult  at 
best  and  often  impossible. 

b .  Recommendations 

A  systematic  effort  should  be  undertaken  to  develop  a 
stepwise  implementation  of  a  complete  and  uniform  cost 
accounting  system  throughout  DOD,  with  emphasis  on  valid 
input  data.  This  system  must  be  compatible  with  the 
cost  accounting  system  for  DOD  contractors  that  is 
evolving  under  the  aegis  of  the  Cost  Accounting  Stand¬ 
ards  Board.  It  must  allow  meaningful  comparison 
between  Service  in-house  costs  and  contractor  costs  on 
individual  systems,  subsystems,  and  equipments.  As  a 
first  step,  a  marginal  cost  system  using  sampling 
techniques  for  support-cost  inputs  should  be  imple¬ 
mented.  The  system  must  then  evolve  to  cover  full  costs 
of  both  acquisition  and  support. 

irk  A  central  organization  within  OSD  should  be  designated 
to  organize  this  cost  information  system  and  to  co¬ 
ordinate  the  efforts  of  responsible  Service  elements. 

★  To  test  and  exercise  the  system,  each  Service  major 

procurement  command  should  designate  certain  electronic 
systems  for  review  of  cost  reporting  requirements.  Ap¬ 
propriate  steps  should  be  taken  to  ensure  consistency 
among  the  report  outputs,  complete  record  retrieval, 


★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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and  periodic  validation  of  the  reported  costs.  These 
records  should  be  centrally  located  and  should  be  made 
available  to  the  cost  analysis  community. 

4.  Schedule -Estimating  Uncertainties 

The  demonstrated  inability  of  both  Government  and  industry  to 
estimate  reliability  and  costs  is  matched  by  an  inability  to  estimate 
development  and  production  program  schedules.  For  electronics,  this 
is  a  critical  concern,  since  many  electronic  equipments  or  systems 
become  critical  subsystems  of  integrated  weapons  systems.  Optimis¬ 
tic  scheduling  at  the  subsystem  level  can  result  in  severe  disrup¬ 
tions  in  schedule  at  the  system  level,  with  attendant  cost-growth 
consequences. 

Schedule-estimating  uncertainties  can  also  have  a  significant 
impact  upon  the  success  of  the  design-to-cost  concept.  The  production 
cost  for  a  newly  developed  system  will  be  sensitive  to  the  expected 
date  of  initial  production  as  well  as  the  expected  production  rate. 

The  initial  production  schedule  will,  of  course,  be  heavily  dependent 
upon  the  scheduling  of  the  successful  completion  of  the  final  develop¬ 
ment  test  program  or  prototype  demonstration  phase.  Schedules,  as 
well  as  costs,  must  be  estimated  realistically  if  the  design-to-cost 
concept  is  to  be  viable.  (See  Section  III-C.) 


t 


t 


l 


The  experience  of  the  last  15  years,  however,  does  not  provide 
an  encouraging  picture.  As  shown  in  Table  III-ll,  several  inve^tiga 
tors  have  found  that  original  development  program  schedules  have 
grown  by  averages  of  33  to  61  percent. 

A  GAO  studyl  separated  data  on  weapon-system  schedule  growth 
into  five  commodity  groups:  aircraft,  missiles,  ships,  electronics, 
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and  vehicles  and  ordnance.  This  study  demonstrated  that,  for  the 
sample  of  weapons  studied,  electronic  equipment  achieved  the  highest 
average  schedule  growth  of  all  five  commodities,  with  a  56  percent 
growth  factor  during  development  (Fig.  III-3).  If  the  GAO  data  are 
representative  of  the  overall  schedule-estimating  capability  for 
electronic  equipment,  this  is  a  significant  problem  area. 


TABLE  IIT-11. 

SCHEDULE  GROWTH  EXPERIENCE: 

DEVELOPMENT 

Number  of 

Percentage 

Investigator( s) 

Systems 

Schedule  Growth 

Peck  and  Scherer’’ 

12 

3u% 

Scherer^ 

12 

60% 

GAO  ( 1970 ) 1 

50 

33% 

Rand  Corp.7 

10 

40% 

GAO  ( 1972)1 

49 

34% 

IDA8 

50 

61% 

An  investigation  made  by  the  Electronics-X  Study  team  into  the 
area  of  schedule  estimating  revealed  that  major  program  schedules 
commonly  have  not  been  derived  from  comprehensive  program  planning 
but  have  been  determined  from  larger  program  timetables,  force - 
planning  considerations,  budgetary  funding  factors,  and  political 
do'"’ is  ionmaking.  It  was  also  found  that,  with  the  exception  of  the 
PERT  networV  methodology,  development  of  estimating  tools  was  virtually 
nonexistent.  Much  work  remains  to  be  done  in  this  area. 

a .  Findings 

•  Schedule  growth  has  been  as  pervasive  as  cost  growth 
during  the  recent  past. 

•  The  causes  for  schedule  growth  were  also  investigated, 
and  the  following  were  found  to  be  influencing  factors: 
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FIGURE  1 11-3 .  Schedule  Slippage  in  Five  Weapon- System  Groups 
(Source:  Ref.  I,  July  17,  1972) 
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Inadequate  program  definition 

-  Problems  of  interface  with  Government -furnished  equip¬ 
ment 

-  Optimistic  test  programming 

-  Delays  in  delivery  by  subcontractors/vendors 

-  Changes  in  product  configuration 

-  Delays  and  stretchouts  of  incremental  funding 

-  Delays  in  program  initiation 

-  Delays  in  Government  approvals. 

Optimistic  programming  and  failure  to  plan  for  development 
problems  have  influenced  scheduling  estimates  in  much 
the  same  manner  as  they  have  influenced  cost  estimates. 

•  Unlike  the  cost-growth  problem,  little  attempt  has  been 
made  to  improve  existing  data  bases  and  estimating 
methodologies  or  to  recognize  bias  by  detailed  verifica¬ 
tion  of  schedule  estimates. 

•  Despite  the  rather  good  availability  of  historical  data  on 
schedules ,  little  serious  analytical  work  on  estimating 
schedules  has  been  done  to  date.  Schedule  estimation  for 
electronics  is  a  prime  example  of  an  area  where  a  small 
effort  could  yield  important  cost  savings  and  improved 
program  planning. 

b.  Recommendations.  At  least  three  immediate  steps  can  be 
taken  to  improve  schedule -estimating  capability: 

(1)  Link  schedule-estimating  efforts  to  cost-estimating 
efforts  to  emphasize  their  interrelationships,  and 
provide  for  an  increased  data  base  from  past  experience. 

(2)  Continue  to  develop  schedule-estimating  methodology 
for  Rf,D  and  production  of  electronic  equipment. 

(3)  Analyze  schedule  estimates  as  carefully  as  cost  esti¬ 
mates  in  design-to-cost  electronics  acquisition. 
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5.  Uncertainties  in  Reliability 


In  the  following  paragraphs,  we  shall  discuss  several  major 
shortcomings  in  specification,  measurement,  and  reporting  of  the 
reliability,  availability ,  and  maintainability  (RAM)  of  electronic 
subsystems,  and  we  shall  also  discuss  shortcomings  in  the  resulting 
corrective  actions.  We  shall  conclude  with  a  few  recommendations 
whose  implementation  is  likely  to  lead  to  substantial  improvements  in 
the  RAM  of  electronics. 

a.  RAM  Requirements,  Criteria,  and  Specifications.  As  some 
case  studies  cited  in  Section  III-P  suggest  and  as  numerous  discus¬ 
sions  with  industry  executives  confirm,  RAM  requirements  are  usually 
the  result  of  guesswork,  reasoning  by  analogy  with  other  only 
vaguely  similar  equipment,  or  attempts  to  push  the  art  ahead.  Very 
rarely  is  a  RAM  requirement  the  result  of  mission  analysis  and  cost- 
benefit  tradeoff.  Often,  a  RAM  requirement  is  unattainable  at  a 
reasonable  cost  in  equipment  of  the  expected  complexity  (Fig.  I T - 5 , 
p.  S9).  The  same  is  often  true  for  some  of  the  other  requirements  of 
a  system,  but  the  generally  poor  understanding  of  the  significance, 
measurement,  and  cost  of  RAM  makes  it  very  difficult  for  formulators 
of  requirements  to  make  the  tradeoff  between  high  RAM  at  a  high 
acquisition  cost  on  the  one  hand  and  low  RAM  at  a  high  maintenance 
cost  on  the  other.  The  resulting  RAM  requirement  usually  contributes 
heavily  to  the  high  cost  of  military  electronics. 

In  order  to  have  a  rational  basis  for  RAM  specifications, 
it  is  essential  to  know  the  nature  of  each  phase  of  the  mission  of 
a  system,  including  the  mission’s  duration  and  operational  environ¬ 
ment.  It  is  also  necessary  to  determine  what  constitutes  satisfactory 
operation  during  each  phase  of  the  mission  and  what  reliability  is 
practically  attainable  at  affordable  cost  in  equipment  cl  the  planned 
complexity.  The  maintenance  concept  must  be  spelled  out,  and  the 
quality  of  maintenance  available  must  be  foreseen.  Such  a  procedure 
is,  in  fact,  followed  by  the  National  Aeronauti  s  and  Space  Administra¬ 
tion  (NASA)  and  is  largely  responsible  for  the  excellent  RAM  results 


obtained  by  that  organization,  although  at  a  very  high  acquisition 
cost. 

Unlike  NASA  systems,  military  systems  are  usually  intended 
to  operate  in  a  broad  range  of  mission  envelopes.  Moreover,  the 
real  military  operating  environment,  including  quality  of  maintenance, 
is  rarely,  if  ever,  anticipated  by  formulators  of  requirements  for 
military  systems.  Their  lack  of  foreknowledge  of  the  actual  mainte¬ 
nance  environment  can  be  traced,  in  part,  to  the  fact  that  changes 
affecting  maintenance  are  usually  not  reported  back  to  the  manufac¬ 
turers  or  to  the  procuring  commands  in  a  way  that  would  enable  design 

engineers  to  acquire  a  correct  understanding  of  the  maintenance 
g 

problem.  Further,  the  multilevel  approval  process  contribute ^  to  a 
strong  preference  for  use  of  RAM  criteria  that  have  a  simple  intuitive 
meaning  and  can  be  explained  to  many  levels  of  management.  Thus,  RAM 
requirements  have  come  to  be  stated  and  discussed  in  terms  of  mean 
time  between  failures  (MTBF) ,  mean  time  to  repair  (MTTR) ,  and  other 
quantities  derived  from  these.  These  concepts  are  valid  only  under 
certain  restrictive  assumptions.  The  usual  definition  of  the  required 
maintenance  method  and  the  usual  description  of  the  operating  environ¬ 
ment  are  quite  inadequate  to  ensure  the  validity  of  the  MTBF  concept, 
however.  Test  plans  are  usually  drawn  to  demonstrate  the  performance 
of  a  system  under  standardized  test  conditions  that  resemble  neither 
the  operational  environment  nor  the  effects  of  operational  maintenance 
on  the  system.  When  the  system  is  fielded,  its  performance  is  usually 
communicated  in  terms  of  simple  but  not  too  meaningful  parameters, 
namely,  MTBF  and  maintenance  man-hours  per  maintenance  action,  without 
an  adequate  description  of  the  actual  operating  environment  or  the 
actual  quality  of  the  maintenance.  Sometimes  field  reliability  is 
reported  in  terms  of  mean  flight  hours  between  failures  CMFHBF),  a 
quantity  that  does  not  necessarily  have  a  simple  relationship  to 
MTBF  and  MTTR.  The  results  give  an  incomplete  and  inaccurate  picture 
of  the  reliability  of  military  systems,  and  that  picture  then  serves 
as  a  basis  for  future  management  judgments.  This  often  leads  to  the 
formulation  of  more  elaborate  and  more  demanding  RAM  requirements. 
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A  vicious  circle  is  thus  completed,  leading  to  overspecified  and  under 
achieved  RAM  while  contributing  heavily  to  the  high  cost  of  electronic 
systems. 

The  chart  in  Fig.  Ill -4  has  often  been  used  to  show  the  in¬ 
adequacy  of  tactical  airborne  radars  by  comparing  specified  MTBFs 
with  actual  MTBFs.  Completely  absent  from  the  chart  are  a  number  of 
important  pieces  of  information  essential  to  a  complete  description  of 
the  problem.  The  fact  is  hidden  that  20  to  50  percent  of  the  avionic 
equipments  removed  and  recorded  as  failures  are  later  found  to  be  in 
satisfactory,  well-functioning  condition  (50  to  50  percent  was  esti¬ 
mated  as  typical  in  the  airline  industry  by  W.  Carnes,  Arinc;  a  20 
percent  figure  was  found  from  1970-71  data  on  noncombat  squadrons  of 
F-4J,  A-7E,  and  A-6A  aircraft,  as  reported  by  the  Navy’s  Maintenance 
and  Material  Management  (3M)  systems;*  a  figure  of  30  percent  for 
cabin-pressure  controllers  was  reported  by  H.W.  Adams  and  H.  Boyer  at 
the  6th  Annual  FAA  International  Symposium,  8  December  1970;  and  40 
percent  was  the  figure  found  by  AFLC  for  the  Litton  N-16  inertial 
platform  well  into  the  0T8E  phase3).  Thus,  the  true  field  MTBF  of 
avionics  may  be  expected  to  be  higher  by  a  factor  of  1.5  to  2  than  the 
reported  field  MTBF  because  of  no-fault  removals.  Similar  factors  may 
be  expected  in  other  electronics . 

On  a  more  fundamental  level,  the  use  of  MTBF  implicitly 
assumes  that  all  failures  are  alike  and  that  every  repair  action 
brings  the  equipment  back  to  like -new  condition.  Both  of  these  as¬ 
sumptions  are  generally  untrue.  It  also  assumes  that  failures  are 


*These  no-fault  figures  include  organizational  and  intermediate  levels 
only.  No  figures  are  quoted  for  no-faults  discovered  at  depots. 

Depots  operate  on  a  batch-processing  basis.  By  the  time  an  equipment 
has  been  returned  to  a  depot,  most  of  the  expenditures  (e.g.,  ex¬ 
penditures  for  paperwork,  removal  and  replacement,  and  transporta¬ 
tion)  entailed  in  the  repair  cycle  h3ve  already  been  made.  Thus,  in 
most  cases,  it  makes  no  sense  to  spend  much  effort  to  determine 
whether  a  subsystem  is  working,  which  may  mean  that  it  still  has  about 
50  percent  of  its  useful  life  ahead.  It  is  more  economical  to  go 
ahead  with  a  complete  overhaul  to  restore  the  equipment  to  like- 
new  condition. 
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indeed  correctly  attributed  to  the  faulty  electronic  subsystems; 
this  assumption  is  often  wrong.  While  these  facts  can  have  a  large 
effect  (possibly  as  much  as  a  factor  of  20)  on  the  apparent  field 
MTBF,  quantification  is  most  difficult  indeed,  and  generalization  from 
one  equipment  to  another  may  be  unwarranted. 


MTBF,  hr 

11-4  '3-6 

FIGURE  1 1 1-4.  Specified  and  Actual  MTBFs  of  Tactical  Airborne  Radars 


The  use  of  MTBF  also  obscures  the  fact  that  failures  of 
equipment  usually  come  in  clusters,  and  that  often  this  can  be  traced 
to  poorly  trained  maintenance  personnel  who  tend  either  to  repair 
equipment  inadequately  after  the  first  failure  or  to  remove  well¬ 
functioning  equipment  without  sufficient  cause.  In  a  study  of  a  sample 
of  AN/AWG-10  fire-control  radars,  Westinghouse  observed  a  field  MTBF 
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of  7.5  hours.  Then,  when  experienced  technicians  servicing  these 
radars  were  replaced  by  neophytes,  the  MTBF  of  the  very  same  sample 
of  radars  under  the  very  same  operating  conditions  suddenly  dropped 
to  3.8  hours,  down  by  a  factor  of  2.  This,  of  course,  is  nothing 
surprising.  It  is  a  typical  learning-curve  effect.  It  simply  shows 
the  inadequacy  of  MTBF  alone  as  a  measure  of  field  RAM,  since  MTBF 
can  easily  vary  by  a  substantial  factor  because  of  an  unreported 
circumstance  such  as  a  change  in  the  degree  of  experience  of  the 
maintenance  force. 

Let  us  discuss  the  connection  between  specified  MTBF  and 
field  MTBF  in  somewhat  greater  detail.  There  exists  an  inherent 
MTBF  typical  of  in-plant  test  conditions,  where  all  pertinent  param¬ 
eters  are  adequately  controlled.  When  equipment  is  taken  into  the 
operational  environment,  certain  new,  unpredictable  effects  begin  to 
show  up,  many  of  which  are  directly  caused  by  human  failings.  Thus, 
every  "inherent"  equipment  failure  that  necessitates  a  maintenance 
action  exposes  equipment  to  the  possibility  of  suffering  another 
maintenance-induced  failure.  Such  failures  often  occur  because 
maintenance  actions  under  field  conditions  expose  equipment  to  various 
kinds  of  direct  damage  by  inexperienced  maintenance  personnel,  such  as 
short-circuiting  by  wrong  use  of  test  leads  and  breakage  by  dropping. 

Failures  of  electronics  are  also  caused  by  human  abuse.  For 
example,  a  communication  set  was  tested  in  a  plant  and  found  ac¬ 
ceptable.  Then  it  was  installed  in  a  tank,  where  the  gunner  used  it 
as  a  stepladder  and  broke  off  its  protruding  knobs.  This  was  a  fail¬ 
ure  that  could  not  have  been  readily  foreseen  on  the  basis  of  in-plant 
tests  but  might  have  been  avoided  by  human-factors  engineers  with  suf¬ 
ficient  field  experience. 

Still  other  "failures"  are  apparent  only.  Such  "failures" 
are  often  charged  to  a  subsystem  by  a  Service  maintenance  data  col¬ 
lection  system  even  though  they  entail  only  unnecessary  maintenance. 

A  case  in  point  is  the  unnecessarily  frequent  calibration  of  a  Singer- 
Kearfott  AN/ASN-90  inertial  navigation  unit  that  was  improperly 
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charged  against  the  unit  by  the  Air  Force  AFM  66-1  reporting  system. ^ 
All  these  failures  become  part  and  parcel  of  the  "field  MTBF"  that  is 
now  used  as  a  measure  of  the  field  performance  of  an  electronic  sub¬ 
system. 

To  summarize: 

1.  RAM  requirements  and  specifications  must  be  based  on  the 
best  possible  mission  analysis,  taking  into  account 

the  range  of  missions  planned  for  the  system  and  the 
realizability  of  the  proposed  RAM  specifications  in  an 
equipment  of  the  proposed  complexity  and  unit  production 
cost. 

2.  For  each  phase  of  each  mission,  a  suitable  set  of  RAM 
parameters  can  be  specified,  measured,  and  reported. 

For  example ,  one  or  more  of  the  following  parameters  may 
be  specified:  MTBF,  MTTR,  probability  of  mission  suc¬ 
cess,  availability ,  effectiveness,  probability  of  m  out 
of  n  units  surviving,  or  mean  time  between  maintenance 
actions.  This  will  entail  imposing  special  RAM  reporting 
requirements  for  each  system,  and  methods  for  accom¬ 
plishing  this  will  still  have  to  be  worked  out. 

3.  Methods  must  still  be  developed  for  describing  quanti¬ 
tatively  the  effects  of  the  actual  use  environment  and 
the  maintenance  setup.  This  is  essential  in  order  to 
provide  a  complete  RAM  specification  and  relevant  meas¬ 
urement  techniques. 

Findings  and  recommendations  stemming  from  the  above  are 
presented  at  the  end  of  the  next  section. 

b.  RAM  Reporting  Systems.  Let  us  next  review  the  information 
systems  upon  which  we  currently  depend  for  RAM  data.  First,  there  are 
the  readiness  reporting  systems.  Readiness  is  a  very  important 
quantity  militarily.  Moreover,  the  military  commander  is  usually 
rated  on  his  readiness.  Table  III-12  shows  that  only  instruments, 
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the  bombing  navigation  system  on  a  bomber,  and  a  few  other  electronic 
subsystems  cause  mission  aborts  either  on  the  ground  or  in  the  air. 
Thus,  while  some  electronic  subsystem  failures  may  contribute  to  a 
"reduced  material  condition,”  they  are  not  really  likely  to  be  discus¬ 
sed  in  a  readiness  report  in  sufficient  detail  to  allow  any  meaningful 
deduction  of  RAM  data,  nor  will  the  listing  of  the  Work  Unit  Cides 
(WUC)  in  the  readiness  report  be  sufficiently  inclusive  to  serve  as 
a  useful  catalog  of  the  current  RAM  problems. 

The  existing  sources  of  maintenance  data  are  shown  in 
Tables  III-13  through  III-15.  Maintenance  data  collection  systems 
(MDCSs),  such  as  the  Navy’s  Maintenance  and  Material  Management  (3M) 
systems,  collect  data  at  the  base  level  in  enormous  quantities,  as 
the  2.5  million  records  per  month  of  3M-Aviation  (Table  III-14)  show. 
The  records  are  mainly  intended  for  local  management  of  maintenance 
and  logistic  support.  They  report  man-hours  expended  and  material 
used.  Emphasis  is  on  safety -related  equipments,  and  consequently 
aviation  coverage  is  maximized.  AFM  66-1  is  the  largest  such  system, 
3M-Aviation  is  the  next  largest,  and  The  Army  Maintenance  Management 
System — Aviation  (TAMMS -Aviation)  is  the  smallest.* 

RAM  data  is  strictly  a  byproduct  of  these  systems — and,  one 
might  add,  a  very  insufficient  byproduct,  because  essential  qualifying 
or  explanatory  RAM  information  is  often  not  noted.  RAM  data  can 
serve  as  a  red-flag  device;  for  example,  when  fairly  frequent  failures 
are  noted  in  the  output  of  3M,  a  detailed  investigation  is  obviously 
in  order.  The  problem  is  that  the  data  from  this  system  is  usually 
punched  into  cards  locally  and  processed  for  local  purposes.  For  more 
elaborate  processing,  it  is  forwarded  monthly  to  a  central  location. 

By  the  time  it  is  likely  to  reach  the  producer  command  or  the  manu¬ 
facturer,  this  data  is  two  to  three  months  old,  and  thus  it  is  a 
very  sluggish  warning  signal.  Only  readiness-related  information  is 
processed  faster,  and  we  have  already  discussed  its  weaknesses  as  a 


*The  Army  Maintenance  Management  System --Sample  Data  Collection 
(TAMMS-SDC)  will  be  discussed  separately. 
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TAPLE  III -15.  SOURCES  OF  MAINTENANCE  DATA  APPLICABLE  TO  ELECTRONICS 

Service( s) 

A.  Maintenance  Data  Collection  Systems  (MDCSs), 

Operational 


1. 

Aviation  Maintenance  L  Material  Management 
( 3M-Aviation) 

Navy , 

USMC 

2. 

Ships  Maintenance  &  Material  Management 
( 3M-Ships) 

Navy 

3. 

Maintenance  Data  Collection  System  (AFM  66-1) 

USAF 

4. 

The  Army  Maintenance  Management  System-- 
Aviation  (TAMMS -Aviation) 

Army  Aviation 

5. 

The  Army  Maintenance  Management  System — 

Sample  Data  Collection  ( TAMMS -SDC) 

Army , 

General 

B. 

Depot  Maintenance  Reports 

1. 

Disassembly  and  Inspection  Report  (DIR) 

Navy, 

USAF 

2. 

Depot  Data  System  (AFLCM  66-15) 

USAF 

C. 

Exception  Reports,  Operational 

1. 

Unsatisfactory  Removal  Report  (L1R/UMR) 

Navy, 

USAF 

2. 

Emergency  Unsatisfactory  Removal  Report 
(EUR/EUMR) 

All 

3. 

Accident  Report 

All 

4. 

Equipment  Improvement  Request  (EIR) 

Army 

5. 

Engineering  Investigation  Request  (EIR) 

Navy 

D. 

Other  Data  Sources 

1. 

Field  Commander  Message  Traffic 

All 

2. 

Contractor  Field  Representatives 

3. 

Technical  Field  Representatives  of  Producer 
Commands 

All 

E. 

Rank -Ordering  Data -Processing  Systems 

1. 

Increase  Reliability  of  Operational  Systems 
(IR0$) 

USAF 

2. 

Improved  Management  of  Procurement  and 
Contracting  Techniques  (IMPACT) 

Army 
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TABLE  III -14.  CHARACTERISTICS  OF  MAINTENANCE  DATA  COLLECTION 
SYSTEMS  (MDCSs) 


•  Voluminous 

Typical  Total  Numbers  per  Month  of  Reports 
Including  Electronics  Information,  millions 


TAMMS -Aviation: 

0.9 

3M-Aviation: 

2.5 

3M-Ships: 

0.7 

AFM  66-1: 

5.0 

•  Primary  Purpose  is  Management  of  Maintenance  and  Logistic 
Support 

•  RAM  Data  is  a  Byproduct 

•  Problems  in  Accuracy  and  Completeness 

•  Problems  in  Timeliness  (processed  data  is  2-3  months  old 
when  it  reaches  producer  command  or  contractor) 

•  Poor  Coupling  of  Data  to  Industry 


TABLE  III-15 .  CHARACTERISTICS  OF  EXCEPTION  REPORTS 


•  Smaller  Quantity 

Topical  Total  Numbers  per  Month  of  Reports 
_ Including  Electronics  Information 

Air  Force:  2000  EUMRs 

Army  Aviation:  1750  EIRs 

Naval  Aviation:  100  '’Safety”  URs 

2500  "Special"  URs 
40  EIRs 

•  Greater  Depth  in  Problem  Description 

•  More  Likely  to  Result  in  Direct  Action 
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RAM  feedback  channel.  Moreover,  the  maintenance  data  collection 
systems  extend  only  to  repairs  at  bases;  they  do  not  include  repairs 
at  depots,*  where  much  complex  electronic  gear  is  repaired.  Some  data 
on  repairs  at  depots  is  available  via  the  depot  maintenance  reports 
(Table  III-13),  which,  like  URs  (see  next  paragraph  on  exception 
reports),  are  narrative  responses  to  specific  queries  and  are  not 
comprehensive  information-gathering  systems. 

By  far  the  most  useful  reports  for  initiating  direct  action 
are  the  exception  reports.  They  provide  narrative  problem  descrip¬ 
tions,  and  their  volume  is  relatively  small--only  several  thousand 
records  per  month  instead  of  millions  for  the  3M  or  the  AFM  66-1 
(Table  III-15).  However,  Service  personnel  are  reluctant  to  use  them 
unless  a  very  clear-cut  reason  exists.  Consequently,  exception  reports 
do  not  provide  data  about  recurring,  subcritical  failures  that  might  be 
significant  as  forerunners  of  serious  trouble  or  as  opportunities  for 
eliminating  frequent  minor  failures.  Thus,  exception  reports  are  not 
routine  RAM  reporting  systems.  Furthermore,  they,  too,  rely  on  the 
judgment  of  the  men  on  the  spot,  and  often  the  men  on  the  spot  are 
inadequately  trained  repairmen. 

Critical  problems  are  usually  reported  by  Field  Commander 
Message  Traffic  and  do  get  high-level  attention  rapidly,  but  Field 
Commander  Message  Traffic  is  a  limited,  special-purpose  system. 

Certain  other  information  channels  exist,  including  reports 
of  contractors'  technical  field  representatives,  accident  reports, 
and  incident  reports.  Each  of  these  kinds  of  report  provides  data 
in  a  different  format.  Among  them,  the  reports  of  contractors'  field 
representatives  are  usually  the  most  helpful  to  manufacturers  and  to 
producer  commands  in  pinpointing  specific  RAM  problems  and  in  helping 
to  obtain  definitive  solutions.  The  point  is  that  a  contractors' 
field  representative  is  technically  trained,  is  familiar  with  the 
equipment,  knows  what  to  look  for,  knows  to  some  extent  the  conditions 


*See  footnote  on  p.  101. 
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under  which  the  equipment  has  been  used  or  serviced,  and  is  motivated 
to  report,  particularly  if  the  equipment  is  under  warranty. 

Certain  military  producer  commands  have  their  own  technical 
field  representatives.  Examples  are  the  Air  Force  Engineering 
Technical  Service  (AFETS),  which  reports  to  arious  Air  Force  com¬ 
mands,  the  Naval  Aviation  Engineering  Service  Unit  under  the  Assistant 
Commander  for  Logistics/Fleet  Support,  Naval  Air  Systems  Command 
Headquarters  (NAIR-04),  and  the  Technical  Assistance  and  New  Equip¬ 
ment  Training  Division,  Army  Electronics  Command  (AECOM).  In  fact, 
AECOM  maintains  one  technical  representative  per  $2  ni ~ 11 ion  to  $6  mil¬ 
lion  of  new  equipment  that  it  is  fielding  at  any  one  time  (or  one 
technical  representative  per  $20  million  of  the  AECOM  weapons  inven¬ 
tory).  Generally,  technical  representatives  of  producer  commands 
concentrate  their  efforts  on  defining  and  helping  to  solve  the  tech¬ 
nical  problems  of  relatively  new  equipments. 

Coupling  to  industry  of  the  data  produced  by  the  maintenance 

data  collection  systems  is  relatively  poor.  Such  data  is  not  usually 

distributed  automatically  to  contractors  but  is  available  to  them 

upon  request.  Unfortunately,  lack  of  confidence  in  these  massive 

maintenance  data  collection  systems  results  in  very  few  contractor 

requests  for  and  little  utilization  of  the  Navy’s  3M  summaries  or  the 

g 

Air  Force’s  AFM  66-1  summaries. 

The  Services  have  been  trying  to  remedy  some  of  the  problems 
entailed  in  the  huge  volume  of  the  AFM  66-1  and  3M  systems  by  pro¬ 
viding  reports  that  rank  the  major  problems  according  to  decreasing 
priority.  The  Air  Force  system  for  doing  this  is  IRO$  (Table  III-13), 
which  provides  a  capability  to  rank  data  as  to  cost,  safety,  and 
availability .  This  capability  permits  the  ranking  of  each  problem  in 
components  of  an  Air  Force  weapon  system  at  the  lowest  possible 
work-unit  code  level,  thus  making  the  problems  visible  to  management 
at  the  system,  subsystem,  and  component  levels  and  allowing  cor¬ 
rective  actions.  The  IR0$  system  also  provides  historical  logistic 
support  data  to  designers  and  developers  of  new  systems.  While  this 
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greatly  improves  the  utility  of  the  output,  it  does  riot  correct  the 
inadequacies  of  the  inputs  and  the  result ing  data  base.  A  somewhat 
different  system,  known  as  IMPACT  (Table  TIT-13),  is  in  effect  at 
the  Army  Materiel  Command.  Its  major  function  is  to  direct  the  at¬ 
tention  of  management  to  certain  selected  tasks  and  to  the  progress 
made  in  accomplishing  them.  IMPACT  also  continues  to  depend  on  the 
existing  data  base. 

Certain  observations  follow  from  the  above.  Ultimately, 
better  ways  of  providing  feedback  of  valid  RAM  information  from  the 
field  must  be  developed.  They  must  serve  the  need  for  a  continuing 
stream  of  routine  RAM  data ,  and  they  must  also  provide  channels  for 
exception  reports  and  narrative  descriptions  when  required  by  the 
producer  commands  and  vendors.  Information  must  become  routinely 
available  not  only  from  bases  but  also  from  depots.  All  the  informa¬ 
tion  streams  must  become  compatible  in  format  to  allow  the  tracing  of 
a  program  or  a  system  and  all  its  relevant  costs  through  a  life  cycle. 
Finally,  the  information  must  be  coupled  automatically  to  the  producer 
commands  and  vendors  for  corrective  actions. 

because  of  the  magnitude  of  these  problems  and  the  tremendous 
extent  of  the  related  information  systems,  changes  must  be  made  very 
deliberately  and  results  will  be  obtained  very  slowly,  often  only 
after  a  number  of  years  of  continuing  effort.  To  effect  more  rapid 
improvement  in  the  cost  and  reliability  of  military  electronics, 
and  to  provide  better  guidelines  for  future  evolution  of  the  various 
maintenance  data  collection  systems,  it  is  essential  to  develop  or 
broaden  a  technical  representative  system  for  the  various  commands 
that  is  like  the  one  used  by  AECOM ,  TAMMS -SDO.  In  the  AECOM  approach, 
a  few  electronic  systems  are  selected  for  sampling  studies.  Then 
the  AMC  Logistics  Data  Center  and  AECOM  prepare  a  Sample  Data  Col¬ 
lection  Plan,  outlining  specific  information  requirements  that  usually 
include  reliability,  availability,  maintainability  (organizational- 
level  maintenance  and  support- level  maintenance),  data  portrayal  re¬ 
quirements,  sample  design  characteristics  ,  resource  requirements, 
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cost  benefits,  and  a  detailed  discussion  of  the  collection  process. 

A  Field  Procedures  Guide  is  also  prepared  to  help  implement  the  data 
collection.  This  document  outlines  in  detail  the  degree  to  which  the 
technical  field  representative  must  oversee  and  participate  in  the 
sample  data  collection  process.  The  information  received  from  the 
field  is  then  processed,  and  action-oriented  monthly  reports  and  a 
final  summary  are  issued.  The  data  collection  period  is  usually  a 
year  but  it  may  be  extended  or  shortened,  as  necessary.  It  has  been 
the  Army's  experience  that  the  data  thus  provided  by  experienced  tech¬ 
nical  field  representatives  is  flexible  in  content  and  format  and 
superior  in  quality  and  accuracy.  As  a  result,  the  data  gets  the 
attention  of  key  Army  and  contractor  personnel. 

An  excerpt  from  a  typical  sampling  report  is  shown  in  the 
Annex  at  the  end  of  this  section. 

The  AECOM  approach  has  the  advantage  of  using  members  of  an 
existing  technical  field  organization  who  are  already  in  most  of  the 
required  locations  for  the  sampling  study,  thus  minimizing  the  required 
outlay.  Recommended  actions  are  then  coupled  directly  to  the  producer 
command  and  to  the  vendor.  Similar  approaches  could  be  undertaken 
by  other  producer  commands,  both  in  the  Army  and  in  the  other  Services, 
to  provide  a  more  reliable  data  base  and  greater  flexibility  in  the 
selection  of  parameters  appropriate  for  each  system.  The  AECOM 
experience  of  having  one  technical  representative  (GS-11  or  GS-12) 
cover  somewhere  between  $2  million  to  $6  million  worth  of  new  equip¬ 
ment  (i.e.,  equipment  less  than  2  years  old)  suggests  the  general 
order  of  magnitude  of  the  staff  required  for  this  broadened  kind  of 
technical  field  representative  function.  Thus,  for  an  acquisition 
budget  of  about  $5  billion  per  year  of  military  electronics,  1000- 
3000  personnel  would  be  required  to  provide  meaningful  training  and 
technical  assistance  with  important  newly  fielded  equipment,  to  report 
on  its  usage,  to  diagnose  its  problems,  and  to  provide  an  expeditious 
reporting  system  that  would  quickly  get  problems  resolved  that  now 
cause  enormous  expense.  Moreover,  armed  with  simple  guidelines,  such 
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personnel  could  provide  an  indication  of  the  real  costs  of  maintenance 
for  new  equipment  by  sampling  maintenance  man-hours  required  for 
typical  tasks  in  the  field.  They  could  also  report  sampled  data  on 
field  reliability  of  equipment. 

At  about  $25,000  per  representative  (this  includes  benefits, 
retirement,  and  ’’direct”  overhead),  1000-3000  representatives  would 
cost  $25-$75  million  annually,  or  about  0.5-1. 5  percent  of  the  total 
electronics  acquisition  budget.  The  additional  expenditures  entailed 
in  sampled-data  collection  are  moderate.  In  the  few  cases  of  Army 
data-sampling  plans  in  effect,  the  cost  was  $60,000  or  $70,000  per 
AN /equipment  type.  U\e  cost  depends  upon  the  information  required, 
the  geographic  distribution  of  equipments,  and  the  number  of  equip¬ 
ment  units  sampled.  Judiciously  used,  such  data  sampling  can  be  a 
very  powerful  approach,  resulting  in  substantial  savings  and  consider¬ 
able  optimization  of  reliability. 

c.  Findings 

•  There  is  no  routine  f ie Id -reliability  reporting  system 
in  DOD  that  can  provide  meaningful  feedback  to  producer 
commands  and  to  manuf acturers  on  the  field  reliability 
of  electronic  subsystems.  Existing  maintenance  data 
collection  systems  were  not  originally  designed  for 
reporting  reliability  data,  and  they  do  not  perform 
this  function  adequately.  Moreover,  there  is  consider¬ 
able  confusion  in  the  terms  used  to  describe  reliability 
They  are  first  used  in  specifications  in  one  context 
and  are  then  employed  in  field  reports  in  another  con¬ 
text.  The  field -use  environment  and  the  field - 
maintenance  environment  are  not  adequately  quantified 
in  field  reports  to  ensure  consistent  interpretation  of 
field  data.  Thus,  field  information  is  ambiguous  at 
best.  This  poses  a  difficulty  in  predicting  and  specify 
ing  reliability  and  in  comparing  the  attained  field 
reliability  with  the  specification. 
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•  There  exists  one  reliability  data  collection  system 
that  appears  to  be  working  effectively:  TAMMS-SDC,  a 
data-sampling  system  used  by  the  Army.  It  utilizes 
technically  trained,  experienced  field  service  person-  ■* 

nel  to  sample  reliability  data  and  certain  other  in¬ 
formation  according  to  individualized  sampling  plans.  ,, 

It  thus  provides  a  possible  model  for  the  rapid,  cost- 
effective  implementation  of  a  data  collection  system 
for  selected  equipments. 

d.  Recommendations 

■  > 

irtrk  In  each  major  producer  command  (AMC,  NMC,  AFSC,  AFLC), 
establish  (or  broaden)  a  system  for  competent  technical 
reporting  of  reliability,  availability ,  and  maintain¬ 
ability  (RAM)  and  marginal  cost  feedback  information 
from  the  field  on  selected  systems  and  equipments,  using 
sampling  methods.  Identify  in  each  such  command  a 
data-sampling  planning  organization  to  plan  and  outline 
in  detail  the  sampled  information  to  be  collected  and 
the  sampling  methods  to  be  used,  and  designate  a  suit¬ 
able  data  processing  activity  to  process  and  distribute 
the  outputs  of  the  data-sampling  system. 

Prime  candidates  for  sample-data  collection  are: 

-  Newly  deployed  systems  during  the  first  year  of 
operation 

-  Systems/subsystems  deployed  in  large  quantity 

Subsystems/equipments  critical  for  the  operation  of 
major  systems  or  being  procured  as  GFE  for  major 
systems. 

Organize  a  RAM  Data  Systems  Task  Force,  representing 
the  several  Services  and  chaired  by  OSD,  to  study  and 
compare  the  relative  cost-effectiveness  of  a  routine 

maintenance  data  collection  system  (such  as  3M  or  AFM 

Highest  priority;  -Hr  high  priority;  ★  priority. 
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66-1)  with  a  sampled-data  collection  system  (such  as 
TAMMS-SDC).  Consider  and  recommend  the  advisability  of 
possible  courses  of  action  such  as  the  following: 

1.  Discontinue  routine  processing  of  TAMMS -Avia ti on , 

3M,  and  AFM  66-1  RAM  data  at  the  national  level. 
Replace  these  systems  by  sampled-data  collection 
systems . 

2.  Continue  processing  at  the  national  level  all 
safety-related  RAM  information,  such  as  3M-Aviation, 
AFM  66-1,  and  TAMMS -Aviation.  Supplement  these 
systems  by  periodic  sampling  studies  to  check  and 
improve  the  information  collected  by  the  maintenance 
data  collection  systems. 

3.  Extend  the  maintenance  data  collection  systems  to 
the  depot  level  in  selected  cases  and  ensure  that 
all  cost  information  and  RAM  information  is  compat¬ 
ible  in  format  (Single- Thread  Data  System)  so  that 
it  can  be  aggregated  by  system. 

★  Establish  a  new  RAM  Information  Exchange  Program  at  the 
electronic  equipment  level  in  a  form  patterned  after 
the  Government-Industry  Data  Exchange  Program  (OIDEP) 
(Table  III-16).  It  should 

-  Provide  automatic  interchange  of  RAM  data  related  to 
parts,  components,  equipments,  subsystems,  and 
systems  utilized  by  the  Services. 

-  Have  participants  from  Army,  Navy,  Air  Force,  NASA, 
Canadian  Military  Electronics  Standards  Agency 
(CAMESA),  and  numerous  contractors. 

-  Be  chartered  by  Joint  Logistics  Commanders. 

Provide  a  forum  for  an  organized  direct  exchange  of 
this  information  with  other  Services  and  with  all 
_  interested  contractors. 

Highest  priority;  high  priority;  ★  priority. 
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TABLE  III-16.  GOVERNMENT-INDUSTRY  DATA  EXCHANGE  PROGRAM  (GIDEP) 


Purpose: 


Participants: 


Technical 
Data  Bank: 


Outputs: 


Organization: 


Advisory 

Groups: 


To  provide  Government  agencies  and  contractors  with 
automatic  interchange  of  technical  data  related  to 
parts,  components,  and  materials  utilized  in  military 
and  space  systems. 

Army,  Navy,  Air  Force,  NASA,  Canadian  Military 
Electronics  Standards  Agency  (CAMESA),  and  300  con¬ 
tractors  . 


Information  on  parts,  components,  materials,  manu¬ 
facturing  processes,  calibration  procedures,  and 
related  technical  data. 

Parts  application  reports,  general  technical  reports 
on  parts,  contractor-generated  reliability  specifica¬ 
tions,  in-process  parts  testing  activity  reports, 
calibration  procedures ,  and  related  documents . 

Chartered  by  Joint  Logistics  Commanders,  and  operated 
by  the  Navy  (Hq,  NMC). 


The  Government  Advisory  Group  and  the  Industry  Advisory 
Group  advise  the  GIDEP  Program  Manager. 
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ANNEX  TO  SECTION  III -A 


EXCERPT  FROM  A  TYPICAL  SAMPLE  DATA  REPORT  OF  THE  ARMY 

ELECTRONICS  COMMAND 
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SAMPLE  DATA  COLLECTION  PLAN 


Radio  Set,  AN/GRC-143 
FSN:  5820-926-7355 

A.  MATERIEL  IDENTIFICATION. 

Radio  Set  AN/GRC-143  is  a  general  purpose,  frequency  modulated 
tactical  radio  set  which  provides  duplex  operation  in  the  4.4  to  5.0 
gigahertz  (GHz)  frequency  range  with  a  continuous  wave  (cw)  power  out¬ 
put  capability  of  1  kilowatt  minimum.  The  AN/GRC-143  was  designed  to 
serve  as  the  basic  radio  set  for  extended  range  radio  relay  systems  for 
the  field  Army.  The  radio  set  can  be  used  for  diffractive  and  tropo¬ 
spheric  scatter  modes  of  propagation  at  ranges  to  100  miles  when  used 
with  a  suitable  antenna,  such  as  antenna  group  AN/TRA-37 .  The  AN/GRC- 
143  Radio  Set  can  be  used  in  two  basic  configurations;  single  stack 
AN/TRC-112  and  double  stack  AN/TRC-121  to  provide  diffractive  and 
tropospheric  communication  over  distances  up  to  100  miles,  with  tele¬ 
typewriter  communications  up  to  200  miles.  It  can  transmit  up  to  24 
voice  channels,  data  or  teletypewriter  signals  in  conjunction  with 
standard  military  multiplex  equipments.  One  radio  set  is  provided 
for  single  stack  pern  terminal  operation  and  is  housed  in  an  equipment 
shelter  such  as  S-336-TRC-112.  Two  radio  sets  are  provided  for  double 
stack  pem  cable  terminal  operation  and  are  housed  in  an  equipment  shel¬ 
ter  S-338/TRC-121.  Operational  procedures  of  the  radio  sets  in  either 
of  the  two  configurations  are  identical.  The  major  components  of 
Radio  Set  AN/GRC-143  are: 

Transmitter,  Radio  T-961/GRC-143 ,  FSN  5820-815-9720 

Receiver,  Radio  R-1287/GRC-143 ,  FSN  5820-935-0129 

Amplifier,  Radio  Frequency  AM-6090/GRC-143  ,  FSN  5820-815- 
97.10 
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B.  OBJECTIVES. 

>  ~ 

The  objectives  of  this  Sample  Data  Collection  Plan  are  to  col¬ 
lect  valid  data  under  controlled  conditions  to  assess  logistic  sup- 

} 

port,  maintenance,  performance  effectiveness,  and  evaluate  the  initial 
provisioning  of  repair  parts  requirements  for  Radio  Set  AN/GRC-143 
when  installed  as  part  of  Radio  Terminal  Set  AN/TRC-112  to  include: 

I 

1.  The  effectiveness  of  Radio  Set  AN/GRC-143  in  terms  of  relia¬ 
bility,  availability  and  maintainability. 


2.  Assessments  of  component  reliability,  availability  and 
maintainability  for  detailed  engineering  and  product  improvement 
considerations . 

3.  Comparative  analysis  of  achieved  performance  characteristics 
under  operational  environments  as  opposed  to  contractor  estimates, 
tests,  and  engineering  predictions. 

4.  Determination  of  the  adequacy  of  initial  provisioning  of 
repair  parts  list. 

C.  INFORMATION  REQUIREMENTS. 

Reliability  and  maintainability  parameters,  repair  parts  consump 
tion,  and  availability  indicators  will  be  determined  for  the  selected 
end  itsm  and  selected  components.  Statistical  and  engineering  analy¬ 
sis  techniques  will  be  used  to  provide  realistic  and  meaningful 
products  directly  applicable  to  management  aspects  of  the  equipment 
system,  such  as  maintenance  ,  quality  assurance,  product  improvement 
and  supply  support. 

1.  RELIABILITY.  The  following  characteristics  will  be  deter¬ 
mined  : 

a.  Mean  time  to  first  failure/replacement . 

b.  Mean  time  between  subsequent  failures/replacements. 

c.  Failure/replacement  rate  analysis. 


2.  MAINTAINABILITY.  (Organizational  level  maintenance)  The 
following  characteristics  will  be  calculated: 


* 
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a.  Mean  active  repair  time. 

b.  Mean  schedule  maintenance  time. 

c.  Mean  total  (end  item)  time  in  Organizational  Maintenance . 

3.  MAINTAINABILITY .  (Support  level  maintenance)  The  following 
characteristics  will  be  calculated: 

a.  Distribution  of  man-hours  to  repair  each  selected  compo¬ 
nent. 

b.  Distribution  of  total  (end  item)  down  time. 

c.  Distribution  of  total  selected  component  down  time  in 
hours  (days). 

4.  AVAILABILITY.  The  following  determination  will  be  made  of 
equipment  availability: 

a.  Inherent  availability. 

b.  Achieved  availability . 

c.  Operational  availability . 

5.  INITIAL  PROVISIONING.  Evaluation  of  the  adequacy  of  initial 
provisioning  of  repair  parts  support. 

6.  DATA  PORTRAYAL  REQUIREMENTS. 

a.  Data  will  be  displayed  in  a  summarized  manner  at  ap¬ 
propriate  time  intervals.  Graphics  will  be  used  as  applicable.  The 
specific  intervals  will  be  determined  as  the  characteristics  of  the 
data  become  apparent  through  analysis.  A  comparison  of  equipment 
performance  parameters  will  be  made  for  the  various  geographical 
locations  designed  for  sampling. 

b.  Selected  components  will  be  evaluated  and  identified 
independently  with  relation  to  their  performance  characteristics  in 
support  of  the  end  item. 

D.  SAMPLE  DESIGN  CHARACTERISTICS. 

1.  The  actual  sample  sizes  determined  will  provide  at  minimum 
a  95%  confidence  level  with  10%  precision.  That  is,  one  can  be  at 
least  95%  confident  that  parameters  estimated  from  this  sample  will 
not  differ  from  the  value  being  estimated  by  more  than  10%.  As  a 
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*  minimum,  the  number  of  sets  to  be  reported  on  for  each  of  the  selected 


locations  is 

as  follows: 

CONARC 

USAREUR 

USARPAC 

USARAL 

33 

20 

24 

2 

i 

> 

) 


2.  The  units  selected  for  sample  data  collection  should  be 
representative  of  the  spectrum  of  activities  and  the  various  environ¬ 
mental  conditions  within  the  command.  This  will  insure  a  thorough 
and  comprehensive  analysis  of  the  sets  under  study. 

3.  The  estimated  duration  for  this  collection  effort  is  one 
year.  However,  this  plan  or  parts  thereof  will  be  terminated  either 
prior  to  or  subsequent  to  the  estimated  duration  if  analysis  indi¬ 
cates  the  objectives  have  or  have  not  been  obtained. 
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*No  support  forms  received  from  USAREUR. 


PARTS  REPLACEMENT  SUMMARY 


PART  NOUN 

PART  FSN 

QUANTITY 

REPLACED 

AVERAGE  TIME 
REPLACED  (HRS) 

HV  INVERTER 

5820  -  136  -  4965 

3 

l.l 

AMPLAF 

5820  -  135  -  4588 

3 

0.7 

OSC  RF 

5820  -136  -  1233 

2 

1.0 

FILTER 

5915  -  196  -  8016 

2 

1.0 

LAMP 

6240  -  763  -  7744 

2 

0.2 

ll-U-'3-l 


Figure  lll-5d  it  a  list  of  five  most  frequently  reploced  portt  as  reported  during  the  first  nine  months  of  the 
AN/GRC-143  SDC  program.  Also  given  is  the  average  time,  in  hours,  which  was  required  to  replace  each 
of  the  parts . 


SAMPLE  DATA  COLLECTION 
READINESS  CHARACTERISTICS--AVAI LABILITY 


COMMAND 

IIS 

IHERENT  'OPERATIONAL  AVAILABILITY 

)  1  40  50  60  70  80 

90  100 

INH 

.9974 

USAREUR 

OPR 

.9974 

V/M 

INH 

.9444 

CONARC 

~1 

1 

OPR 

.4080 

INH 

.9686 

OVERALL 

1 

mil 

OPR 

.5641 

y/m 

Figure  lll-5e  compares  by  command  area  the  operational  and  inherent  availability  of  the  ANl/GRC-143  Radio  Set. 

Historically,  the  operational  availability  of  the  AN/GRC-I43  Radio  Sets  deployed  to  CONARC  has  been  .4060, 
or  approximately  40%;  the  inherent  availability  has  been  .9444,  or  approximately  94%.  Therefore,  the  materiel 
manager  may  expect  40%  or  about  4  of  the  10  deployed  radio  sets  to  be  available  for  operation  at  any  given  time. 
Approximately  96%  of  the  time  the  10  radio  sets  will  not  be  in  active  repair. 
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No  support  forms  received  from  USAREUR. 
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B.  REQUIREMENTS,  DECISIONS  TO  ACQUIRE,  AND  INTERACTIONS  WITH  SYSTEMS 
ACQUISITION 

In  tfcts  world  there  are  only  two  tragedies . 

One  is  not  getting  what  one  wants ,  and  the 
other  is  getting  it. 

--Osoar  Wilde 

The  impact  of  the  requirements  process  is  felt  throughout  the 
acquisition  cycle.  Section  III-A-l-b  (Table  III-4)  showed  that  45 
percent  of  the  cost  growth  of  a  group  of  major  systems  in  FY  1972 
was  due  to  changes  in  requirements.  The  requirements  process  and 
its  impact  are  both  enormously  complex,  and  a  detailed  analysis  of 
the  intricacies  of  the  different  approaches  of  the  Services  has  been 
avoided.  This  examination  concentrated,  instead,  on  the  following 
questions : 

-  Are  the  formal  requirements  processes  of  the  Services  de¬ 
signed  to  work  effectively? 

-  If  they  are  subject  to  aberrations  in  practice  that  can  drive 
costs  significantly,  what  are  those  aberrations? 

-  What  actions  can  be  taken,  from  the  overall  points  of  view 
of  the  Services  and  OSD  management,  to  establish  better 
control  over  costs  through  the  requirements  process? 

Although  much  of  the  analysis  in  this  section  applies  quite  cjp^tally, 
it  has  been  focused  on  electronic  equipment  and  system*  to  the  extent 
feasible  and  useful. 

All  the  Services  use  several  documents  to  discuss  or  establish 
requirements  at  various  levels  of  detail  and  at  various  points  in  the 
decision  process.  There  are  wide  variations  among  the  Services  in 
both  the  terminology  and  the  content  of  these  documents.  If  a 
"requirement”  is  defined  broadly  as  an  expression  of  need  for  a 
military  capability,  then  a  requirement  for  a  specific  equipment  or 
system  in  the  most  general  sense  includes  a  statement  of: 
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1.  Physical  characteristics 

2.  Performance  needed  and  desired  (including  reliability, 
availability,  and  maintainability) 

3.  Numbers  of  equipments  or  systems  to  enter  the  military  forces 

4.  Costs  of  planned  RDTEE,  unit  production,  and  total  program 

5.  Acquisition  schedule. 

Hereafter,  these  will  be  called  the  five  "components  of  a  requirement." 
1.  The  Formal  "Requirements  Process" 

The  requirements  processes  of  the  Services  are  currently  in  a 

state  of  change,  as  the  Services  recognize  their  inherent  problems 

12 

and  attempt  to  solve  them.  At  the  OSD  level,  general  requirements 
for  military  capability  are  expressed  in  JCS  planning  documents,  while 
acquisitions  of  specific  "major"  systems  (in  the  sense  of  DOD 
Directive  5000.1)  are  reviewed  by  the  Defense  Systems  Acquisition 
Review  Council  ( DSARC )  for  recommendation  to  the  Secretary  of  Defense.13 
Systems  less  than  "major"  are  reviewed  in  the  offices  of  the  DSARC 
principals.  Parallel  organizations  exist  in  the  Services,  in  addition 
to  user  requirements  review  offices  and  materiel  or  systems  commands. 

A  functional  outline  of  the  requirements  process,  without  the  Service- 
peculiar  details  and  complexities,  is  shown  in  Fig.  III-6.  Points 
where  DSARC  review  is  currently  required  are  shown.  As  a  result  of 
the  report  of  the  DSARC  Cost  Reduction  Working  Group  (the  "Little 
Four"),14  explorations  are  currently  under  way  to  advance  the  first 
DSARC  review  to  a a  earlier  time,  so  that  the  DSARC  would  consider 
approval  of  a  system  requirement  before  the  initiation  of  development.1^ 
The  document  used  as  a  basis  for  major  system  decisions  is  the  Decision 
Coordinating  Paper  (DCP")>^^  in  which  attention  is  given  to  all  five 
components  of  a  requirement. 

Experience  shows  that,  to  be  as  effective  as  possible,  the  re¬ 
quirements  process  should  (ideally)  incorporate  a  number  of  operational 

*DCP  originally  stood  for  Development  Concept  Paper. 
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PRODUCER . 


NEW  SYSTEM 
’  PROPOSAL 


THREAT  OR  NEED*' 


DSARC  I,  II,  III  REPRESENT  APPROXIMATE 
POINTS  OF  FORMAL  ,'SARC  REVIEW  AND 
SECDEF  DECISION. 


APPROVAL  FOR 

PRODUCTION  &  ACQUISITION 


FIGURE  111-6.  Functional  Representation  of  Requirements  Process 
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properties.  There  must  be  interaction  between  the  user  (the  part  of 
the  Service  that  will  operate  the  system)  and  the  producer  (the  part 
of  the  Service,  with  its  laboratories  and  industrial  contractors, 
that  will  develop  the  system  and  procure  it)  to  ensure  that  each 
understands  both  the  technical  problems  and  the  operating  problems 
of  acquiring  and  using  the  system.  Before  a  requirement  is  established, 
there  must  be  extensive  analyses  to  gain  an  understanding  of  the 
potential  tradeoffs  among  the  five  components  of  the  requirement 
in  relation  to  the  threat  or  need.  Uncertainty  in  assessing  the 
threat  and  in  predicting  performance,  development  cost,  and  schedule 
must  be  recognized  and  allowed  for.  As  the  knowledge  of  cost,  per¬ 
formance,  schedule,  and  threat  is  refined,  the  user-producer  inter¬ 
action  and  the  tradeoff  analyses  must  be  iterated  to  ensure  that 
potential  or  actual  departures  from  the  stated  requirement  (in  all 
five  components)  are  anticipated,  recognized,  understood,  and  dealt 
with. 

Most  but  not  all  of  these  properties  are  inherent  in  the  formal 
requirements  and  acquisition  decision  process  illustrated  in  Fig.  III-6. 
Extensive  pre-requirements  studies  are  usually  carried  out  (they 
always  are,  for  "major"  systems),  and  these  involve  both  user  and 
producer.  While  uncertainty  is  often  included  in  such  studies,  the 
ultimate  expression  of  a  requirement  (e.g.,  in  the  DCP)  does  not 
usually  indicate  uncertainty  ranges  and  their  implications.  Nor  are 
tradeoffs  among  all  the  components  of  a  requirement  necessarily  given 
equal  weight  at  every  stage  of  development  of  the  requirement. 

Table  III-17  summarizes  the  various  formal  requirements  documents  of 
the  Services  in  terms  of  the  attention  given  to  the  components  cf  a 
requirement  in  successively  more  definitive  requirements  statements. 

The  initial  statement,  which  essentially  defines  the  military  cap¬ 
ability  required,  gives  no  desiderata,  or  only  very  coarse  ones,  as 
to  force  size,  schedule,  and  cost.  These  components  are  added, 
essentially  as  modifiers  of  performance  and  physical  characteristics , 
as  the  requirement  becomes  more  specific.  It  can  be  argued,  however, 
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TABLE  III- 17.  STATEMENT  CF  THE  "COMPONENTS  OF  A  REQUIREMENT"  IN 
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SERVICES 

Document 

lertcrnun  e 

fhysr  al 
hut  a  ter  is*  l  s 

.V.nd  *  t 

Cost 

3i  hednle 

Present  Navy* 

General  Operational  Require¬ 
ment  ( GOR ) 

broadly  state.: 
t  •«  10-.  yt 
in  tut die 

r  Miiaries  *. 

*  v*  ra  ir.ts 
t  a  te  ! 

N«  *  tat •  : 

N<  t  stated 

No*  tar*'. 

Ter  tat l  e  Spe'iti  Operational 
Requirement  (TSOR) 

Stared  as 
”  desired” 

Stated  as 
"tentat  iv<” 

‘■t  Jted 

rated  as 
”  planned” 

Stated  as 
"planned” 

Advanced  Development  Ob'O'tive 
{ APC) 

''b  e.  t  i  \  a 

stared 

•e*  er  ally 
state t 

r.e-  *,•  • 

*  t  J * *’d 

,*a*«  * 

Spe  ific  Operational  Require¬ 
ment  (SOR) 

Spe  it:  ally 
stated 

pe  It:  a.lv 
•  *  at  e  1 

•tat*‘d 

S‘a*ed 

t  a  •  e  : 

Proposed  N aw 

Research  *.  Development 

Opera*  nnal  Needs 

broadly  stated 

Ki  ?  per  uds: 
tar-,  mid-,  and 
near-term 

oner  a  1  iv 
stated 

V  •  •  a*e  : 

l •••  is*  i*  g  a*.- 
*  -al  r. :  !e- 
litev) 

V  t  ”d't  1 

Ad  van  ed  Sys*TT  ton  ept  (ASC) 

Far-*erm , 
brouJly  stated 

e  ner  a  1  In¬ 
stated 

!'  t  : nate  j ; ■ 

«•:  Es*  ima*e  g:  er 

Nc*  *  a  *  e  ; 

Ad.ar.ced  Development  Proposal 
( AT’P  (  DSAFC  Ir.tcrma*  ior.) 

Mid-term,  more 
spejiti  ally 
stated 

V  re  spe  .  f 
rally  stated 

'  t  a  *  e  t 

im!  r.ess 

Appr  •:mate 

Engineering  De1  elopmeut 

Ft  pcsal  (EDP)  ( DSARC  II 
and  DrP  Ir.tcmaticn) 

Near -term, 
spe  it :  ally 
Stated 

pt  it:  ally 
sta  «*i 

St  at*  i 

f.-  i!  .  aUy 
stated 

Spe  :t really 
stated 

Arrr.y 

Required  Operational  Capability 
(ROC)  (AF  71-1) 

tateu 

•ate  i 

Ni  •  tar,. d 

Stated  ,  pre¬ 
lim  mar  v 

Net  stated 

De  .elopmer.t  Flan  (IF) 

(AF  7:-;-) 

ta  ted 

f ra*e : 

:'*a*ed 

Stated 

StateJ 

Air  Fer  e 


J* 

Required  perat:  :.al  ~apabili*y 
(PC' ) 

•  a  t  ed 

•  ■ 

>*at»*d  i  *;*•«*  e  r 

•  r! 

v •  ta*e  1 

■:  lv  I"’C 
j  :ve* 

► 

Frogram  Xd:  agene: t  1  tie 

(FMD 

tate  1 

e-erated  by  «*  . 

ta*» 

itjer- 

*.!  ftd»e.‘ 

:r  «  st  ;  jat  :  *  t  as  re  .  . 

:  te  i 

\  V 

r.  t  a  •  e  .1 

i  t  *acK.) 

'  tated 

V 

Program  Xanageme* t  I  lar 

(PMF)--Frn’e  *-'ff:  «»  le  ei 

•■»  at«*d 

•C  *.i*t».! 

rated 

•  tated 

* 


* 


131 


that  a  system  offering  ideal  performance  but  costing  too  much  to  be 
purchased  in  the  needed  numbers,  or  undeliverable  when  needed,  will 
provide  no  more  required  operational  capability  than  a  system  that 
fails  to  perform  as  specified.  Thus,  the  formal  requirements  process 
would  appear  to  encourage  stress  on  performance  before  cost,  schedule, 
and  force  size,  leading  at  the  outset  to  an  inherent  imbalance  in  the 
requirement  s -acqu is  it ion  int e rac  t ion . 

2.  Some  Illustrative  Examples  of  the  Impact  of  Requirements 

The  initial  requirement  specification  influences  cost  and  related 
matters  throughout  the  development  cycle.  The  effects  can  be  appre¬ 
ciated  best  by  examining  how  they  have  worked  in  the  past,  or  how 
they  might  work  on  systems  currently  in  development .  Nine  examples 
of  system  acquisitions  or  requirement  specifications  have  been  ex¬ 
plored  in  varying  degrees  of  detail  for  this  purpose.  The  examples 
were  more  or  less  random,  their  selection  being  determined  by  avail¬ 
ability  of  data,  intrinsic  interest  and  variety  among  the  cases,  and 
time  available  to  acquire  information  about  them.  The  essential 
relevant  information  about  each  example  and  the  main  points  to  be  made 
from  its  history  are  summarized  in  Appendix  C.  The  lessons  learned 
from  the  examples  are  discussed  immediately  below. 

3.  Aberrations  in  Implementing  the  Formal  Process 

Consideration  of  the  examples  cited  in  Appendix  C  shows  that 
aberrations  in  the  requirements  and  acquisition  decision  process  can 
drive  costs  through  several  important  phenomena: 

1.  Misunderstanding  the  need:  demanding  performance  that  is 
out  of  keeping  with  the  threat  or  the  job  to  be  done. 

2.  Insufficient  user-producer  interaction  in  establishing  the 
components  of  a  requirement. 

3.  Insufficient  allowance  for  uncertainty. 

4.  Insufficient  user-producer  iteration. 

5.  Seeking  maximum  possible  performance. 

6.  Unplanned  incorporation  of  new  technology. 
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7.  Inadequate  data  base  for  cost  and  performance  estimates. 

8.  Cascading  of  requirements  at  successively  lower  management 
levels. 

9.  Uncertain  production  base. 

10.  "No  requirement  exists”  when  one  should  exist;  thus,  no 
action  is  taken  to  meet  the  military  need. 

11.  Imperfections  in  the  contracting  process. 

The  full  import  of  these  abbreviated  statements  will  become  apparent 
in  the  succeedin  discussion.  Table  III-18  summarizes  the  distribu¬ 
tion  of  "lessons  learned"  across  eight  of  the  examples  described  in 
Appendix  C.  It  is  immediately  apparent  that  none  of  the  cost-driving 
problems  is  unique  to  any  program,  and  that  all  interact  in  a  complex 
way.  They  can  be  grouped  for  discussion  into  three  main  areas  of 
concern:  establishment  of  the  basic  requirement;  interactions  between 
system  management  and  the  characteristics  or  demands  of  new  technology; 
and  other  management  problems  in  implementation. 

a.  Establishing  the  Basic  Requirement.  Establishing  a  require¬ 
ment  for  a  system  implies  a  commitment  to  incur  the  cost  of  achieving 
the  specified  new  force  structure,  with  its  intended  performance, 
over  the  specified  implementation  schedule.  The  explicit  cost  of 
developing,  acquiring,  and  operating  the  system  can  be  avoided  com¬ 
pletely  by  a  decision  not  to  establish  the  requirement.  The  conse¬ 
quence  is  the  implicit  cost  of  incurred  military  and  strategic  risk 
in  retaining  older,  less  capable  systems  (or  not  developing  a  wholly 
new  capability,  such  as  ICBMs  or  supersonic  fighters  with  guided 
air-to-air  missiles).  Large  elements  of  value  judgment,  some  com¬ 
ponents  of  which  can  be  quantified,  are  involved  in  making  the  choice. 

While  this  formulation  greatly  oversimplifies  the  nature 
of  the  tradeoffs,  there  remains  immense  flexibility  for  choice  between 
the  extremes,  implying  more  or  less  expenditure.  Initially,  it  might 
be  argued  that  a  new  system  will  allow  a  task  to  be  performed  less 
expensively.  History  has  shown,  however,  that  the  more  advanced 
systems  generally  cost  more.’*'7  The  argument  is  then  reduced  to 
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TABLE  III-18.  EXAMPLES  OF  SYSTEM  ACQUISITIONS  OR  REQUIREMENT  SPECIFICATIONS  AND  THEIR 
INTERACTION  WITH  ABERRATIONS  IN  THE  REQUIREMENTS  PROCESS 
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comparative  cost-effectiveness;  the  case  for  the  new  system  can  some¬ 
times  be  demonstrated  conclusively  but  is  more  often  subject  to  argu¬ 
ment,  especially  about  the  assumptions  entering  the  analysis  and 

18 

about  the  value  or  validity  of  performance  measures.  Much  of  this 
argument  revolves  around  uncertainties  in  the  projected  performance 
in  relation  to  the  projected  threat  or  need.  Within  the  bounds  of 
such  uncertainties,  it  may  be  possible  to  achieve  the  desired  per¬ 
formance,  at  less  cost,  although  at  increased  risk,  by  using  tech¬ 
nological  advances  to  improve  one  or  a  few  elements  or  components  of 
an  existing  system  rather  than  to  develop  a  wholly  new  system. 

Figure  III-7  shows  the  progression  of  costs  through  successive 
new  generations  of  a  variety  of  military  systems  that  depend  heavily 
on  electronics  for  their  effectiveness.  With  the  cost  increases,  of 
course,  went  performance  increases;  while  these  are  difficult  to 
measure  in  commensurate  terms  for  the  disparate  systems,  Table  III-19 
suggests  the  nature  of  the  improvements  for  some  of  the  systems  in  a 
qualitative  way.  Figure  III-8  shows  the  cost  growth  of  electronic 
subsystems  for  the  systems  represented  in  Fig.  III-7.  Figure  III-9 
shows  similar  data  for  more  modest  within-generation  system  improve¬ 
ment,  and  Fig.  III-10  shows  the  corresponding  data  for  the  electronic 
subsystems  involved.  Table  III-20  shows  the  qualitative  changes  in 
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performance  achieved  for  these  within-generation  system  modifications. 

Although  the  data  in  Figs.  III-7  through  III-10  are  approxi¬ 
mate,  the  trends  they  imply  are  instructive.  For  the  complete  systems 
shown,  the  new-generation  system  costs  increased,  on  the  average,  by 
about  a  factor  of  5  per  decade  (Fig.  III-7),  while  the  "product  im¬ 
provements"  increased,  on  the  average,  by  only  a  factor  of  2  (Fig. 
III-9).  The  electronic  subsystems  of  these  systems  increased  much 
more  rapidly:  an  average  factor  of  10  per  decade  for  the  electronics 
of  the  new-generation  systems  (Fig.  III-8),  and  6  per  decade  for  the 
electronics  of  the  "product  improvements"  (Fig.  III-10).  As  Table 
III-21  shows,  the  cost  of  new-system  electronics  tended  to  increase 
faster  than  that  of  "product-improvement"  electronics. 


135 


TABLE  III-19.  PERFORMANCE  IMPROVEMENTS  IN 
NEW-GENERATION  SYSTEMS 


Fighter  Aircraft 

•  Aerodynamic  Performance 

•  Size,  Type,  and  Diversity  of  Load 

•  Range  and  Accuracy  of  Target  Acquisition  and 
Weapon  Delivery 

•  Night  and  Weather  Operation 


Air-to-Air  Missiles 

•  Range 

•  Size  of  Engagement  Envelope 

•  Accuracy 

•  Lethality 


SLBMs 


•  Range 

•  Accuracy 

•  Payload 


Tanks 

•  Firepower 

•  Extended  Combat  Conditions  (Night,  Moving) 

•  Agility 

•  Armor 

•  Range  and  Speed 
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FIGURE  1 11—10.  Within- Generation  Electronic  Subsystem  Cost  Progression 


for  Systems  Shown 


TABLE  III-20.  PERFORMANCE  IMPROVEMENTS  WITHIN  GENERATIONS 


Fighter  Aircraft 

•  Range  of  Conditions  (Night,  Weather)  under  which 
Targets  can  be  Acquired 

•  Diversity  of  Air-to-Air  and  Air-to-Ground  Modes 

•  Accuracy  of  Navigation  and  Weapon  Delivery 

•  Electronic  Countermeasures 

•  Aerodynamic  Performance  (Some) 

AIM-9  Air-to-Air  Missile 

•  Acquisition  Capability 

•  Size  of  Engagement  Envelope 

POLARIS  A-1--A-3  SLBM 

•  Range 

•  Accuracy 

•  Penetration  Capability 

M-60  Tank 

•  Armament 

•  Accuracy 

•  Shoot -while -Move 
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TABLE  III-21.  AVERAGE  PER-DECADE  COST-GROWTH  FACTORS 
FOR  SPECIFIC  TYPES  OF  SYSTEMS 


(Based 

on  1972  Dollars) 

Total- 

Electronic- 

Approximate  Electronics 

System 

Subsystem 

Percentage  of  Total 

of  System 

Factor 

Factor 

System  Cost 

New  Generation: 


SLBM  7 

Fighter  Aircraft  5a 

Air-to-Air  Missile  6 

Tank  2 


14 

9 

6 

12 


15%  (I960)— 25%  (1980) 
10-20%  (1958)—  20-30%  (1973) 
60-90%b 

6%  (1963)— 45%  (1975) 


"Product  Improvement 

SLBMC  2  11 
Fighter  Aircraft'1  2  2 
AIM-9e  2  4 
M-60  Tankf  1  8 


aA  factor  of  3-4  is  shown  in  Fig.  II-4,  p.  58;  this  difference  comes 
about  because  the  baselines  are  different.  The  data  here  reflect 
roughly  the  decade  of  the  1960s  (1958-1973),  whereas  the  data  in 
Fig.  II -4  cover  1918-1973. 

^Depends  on  missile  and  range. 

c POLARIS  A-l — A-3  (extrapolated). 

dF-4B-J;  A-4C-F;  A-7A-E;  A-6A-E. 

eAIM-9ri-J. 

^M-60A1  and  M-60 A3  (excluding  M-60A2). 
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It  can  be  inferred  from  these  data  that  much  of  the  cost 
increase  in  "product  improvements"  is  due  to  changes  in  the  electronic 
subsystems.  With  the  rapid  pace  of  technological  change  in  electronics, 
the  large  rate  of  electronics  cost  growth  suggests  that  several  genera¬ 
tions  of  change  in  electronic  technology  were  involved  in  each  sequence 
of  within-generation  system  improvement. 

The  data  of  Figs.  III-7  through  III-10  and  Tables  III-19 
and  III-20  suggest  two  avenues  to  potential  cost  savings  through  the 
establishment  of  requirements.  By  the  first  avenue,  overall  system 
costs  could  be  reduced  through  increased  reliance  on  improvement  of 
existing  systems,  consistent  with  views  of  threat  or  need  (the  latter 
are,  of  course,  subject  to  various  interpretations).  This  is  probably 
true  for  electronic  subsystems  as  well.  The  costs  of  integration  and 
meeting  IOC  for  a  wholly  new  electronic  subsystem  development  under¬ 
taken  as  part  of  a  wholly  new  aircraft  system,  for  example,  is  likely 
to  be  higher  than  the  cost  of  improving  a  subsystem  of  an  existing 
aircraft.  Other  systems  might  follow  this  pattern,  ‘’or  a  new- 
generation  system,  as  compared  with  an  improved  system,  it  is  probably 
also  true  that  subsystem  performance  requirements  are  heightened  to 
capitalize  on  the  greater  capabilities  of  the  platform,  and  this 
points  to  the  second  avenue  to  cost  savings. 

The  majority  of  military  electronics — roughly  80  percent 
of  the  dollar  value* — is  carried  on  ground,  sea,  air,  or  space 
vehicles  as  parts  of  integrated  systems.  The  vehicle  ordinarily  carries 
weapons  or  equipment  to  a  location  to  do  a  job.  (Sometimes,  as  in  a 
communication  or  navigation  satellite  system,  the  sole  purpose  of  the 
vehicle  is  to  carry  the  electronics.)  Usually,  the  amounts  of  time 
required  and  the  technical  problems  to  be  solved  in  developing  a 
vehicle  (be  it  tank,  ship,  aircraft,  or  missile)  and  its  electronic 
subsystems  differ  considerably.  While  development  of  independent 

*See  pp.  50  and  51,  particularly  Table  II-l. 
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electronic  subsystems  need  not  be  tied  to  the  same  schedule  as  develop¬ 
ment  of  their  vehicles,*  very  often  primary  electronic  subsystems  and 
their  vehicles  are  tied  to  the  same  development  schedules  [e.g.,  the 
main  battle  tank  (MBT)  fire  control  system,  the  HELLFIRE  laser  guidance, 
the  F-111B  PHOENIX,  and  the  C-5A  navigation  system]. 

Although  the  time  available  for  this  study  did  not  permit 

quantitative  exploration  of  many  examples  of  alternative  approaches, 
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a  few  examples  such  as  the  E-2C  and  the  B-l,  as  well  as  the  data  of 
Figs.  III-7  through  III-10,  suggest  that  separating  vehicle  develop¬ 
ment  from  electronic  subsystem  development  may  result  in  considerable 
savings.  For  most  systems  in  development,  there  is  likely  always  to 
be  a  useful  subsystem  to  fit  to  the  vehicle  while  a  more  advanced 
subsystem  is  developed  for  it.*  That  is,  improvement  of  total  system 
capability  can  be  taken  in  two  steps.  Of  course,  if  scheduling  of 
electronic  subsystem  development  independently  of  vehicle  develop¬ 
ment  is  to  succeed,  increased  attention  to  form-fit -function  standardi¬ 
zation,  discussed  in  Section  IV-B,  is  essential.  It  follows,  also, 
that  in  this  mode  similar  subsystem  or  equipment  requirements  for  a 
number  of  systems  might  be  merged,  making  additional  savings  possible. 

One  practical  implication  of  the  choices  outlined  above  is 
that  if,  in  a  period  of  budget  constraint,  a  commitment  is  made  too 
early  to  a  completely  new-generation  system,  resources  will  be  un¬ 
available  for  other  necessary  systems.  Conversely,  if  the  threat  or 
need  changes  earlier  than  anticipated  after  the  within-generation 
electronic  system  change  has  been  chosen,  or  if  the  development 
schedules  for  the  vehicle  and  the  electronic  subsystem  have  been 
separated,  necessary  performance  may  become  available  too  late. 

* 

For  example,  the  XM-803  tank  could  have  been  fitted  initially  with 
the  M-60  tank  armament  and  fire  control  system,  upgraded  afterwards 
to  that  planned  for  the  M-60A2  or  M-60 A3  tank,  and  later  to  that 
currently  visualized  for  the  XM-1.  Similarly,  a  laser  guidance 
system  could  be  developed  independently  and  then  retrofitted  to  TOW, 
a  new  air frame -mot or  design  following  at  another  time.  The  C-SA 
could  have  been  equipped  initially  with  C-141  avionics,  thereby  not 
internalizing  to  the  C-5  development  the  cost  growths  illustrated  in 
Fig.  C-2,  Appendix  C. 
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The  preceding  discussion  is  not  meant  to  imply  that  the  con¬ 
servative  choices  are  never  taken;  they  are.  It  is,  here,  a  matter 
of  emphasis.  The  uncertain  and  often  arbitrary  considerations 
involved  are  illustrated  by  several  examples  treated  in  Appendix  C 
[the  Mark  II  avionics,  the  C-5  navigation  system,  the  Advanced  Attack 
Helicopter  (AAH),  and  the  MBT].  While  the  decision  rules  cannot  be 
prescribed  a  priori  for  all  future  system  selections,  the  large 
variations  in  cost -per -change  slope  that  are  inherent  in  the  data 
presented  suggest  that  this  decision  area,  which  appears  at  the  be¬ 
ginning  of  the  acquisition  process,  offers  very  great  leverage  on 
systems  acquisition  costs. 

Associated  problems  in  the  requirements -decision  process 
emerge  from  the  examples  discussed  in  Appendix  C.  Although  many  im¬ 
portant  systems  (e.g.,  SIDEWINDER,  SSB-HF,  ICBM,  Gunship)  have  been 
built  in  the  absence  of  a  formal  requirement  statement  because  a  need 
was  apparent,  the  cases  of  LORAN-D,  PAVE  SPIKE,  and  COMPASS  EAGLE 
show  that  failure  to  establish  a  requirement  can  exact  a  price. 

Delay  in  establishing  a  requirement  and  small  differences  between 
Services  regarding  characteristics  can  reduce  the  production  base  or 
make  it  uncertain,  raising  total  procurement  costs.  Often,  subsystems 
are  accepted  implicitly  as  part  of  a  total  system  requirement  that 
is  approved  without  full  appreciation  of  the  cost -driving  implica¬ 
tions  for  the  subsystems  (as  exemplified  in  Table  C-3,  Appendix  C). 

b.  Interactions  between  Management  and  Technology.  Figure  III -11 

illustrates  schematically  a  typical  set  of  events  in  the  development 

of  a  system  or  subsystem  using  new  technology.  While  the  illustration 

is  intuitively  satisfying,  it  is  difficult  to  assemble  extensive  data 

to  establish  Fig.  III-ll  as  factual.  One  such  real  case  is  illustrated 
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partially  in  Fig.  III-12.  For  comparison  with  actual  cost  experience, 
data  could  not  be  found  regarding  the  initially  proposed  costs  for 
the  systems  included  in  the  two  regression  curves.  However,  the  figure 
does  illustrate  the  tendency  to  move  in  both  the  increased  cost  and 
performance  directions  when  moving  to  a  new  technology. 
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Cost- Performance  Curves  for  Inertial  Navigation  Systems 
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figures  III-ll  and  III-12  illustrate  not  only  the  effect 
of  technological  uncertainty,  but  also  the  danger  of  selecting  a 
proposed  operating  point  too  far  up  on  the  cost -performance  curve. 

As  a  general  matter,  advancing  the  technology  to  a  new  curve  for  any 
system,  as  shown  in  Fig.  III-12,  would  incur  the  "buy-in"  costs  as 
part  of  that  development,  as  happened  in  the  floating -ball -gyro 
inertial  navigation  system  (INS)  for  the  C-SA.  This  gives  additional 
cause  for  conservatism  in  establishing  requirements ;  but  conversely, 
it  can  make  technological  advance  more  difficult  to  achieve. 

The  user-producer  interaction  in  establishing  the  require¬ 
ment  amounts,  essentially,  to  estimating  the  curve  for  the  new 
technology  and  deciding  where  on  that  curve  the  new  operating  point 
should  be.  As  illustrated  by  the  case  of  the  Mark  II  avionics,  if 
there  is  wide  divergence  of  opinion  on  these  matters  the  result  can 
be  costly.  The  producer  may  claim  more  for  the  technology  than  he 
can  deliver,  or  he  may  underestimate  the  cosc  of  delivering  what  can 
ultimately  be  achieved.  Alternatively,  the  user  may  not  know  enough 
about  the  new  technology  and  may  therefore  demand  what  ultimately 
cannot  be  delivered.  Since  the  user  is  usually  in  a  commanding 
position  in  a  Service,  he  can  strongly  influence  both  the  producer 
within  that  Service  and  the  producer’s  in-house  or  industrial  con¬ 
tractors  to  acquiesce  in  such  demands  in  order  to  be  responsive  and-- 
in  the  case  of  industry — to  capture  the  business  despite  the  risks. 

Another  source  of  cost -driving  uncertainty  is  the  "require¬ 
ments  pyramid"  illustrated  in  Table  III-22.  For  the  AAH,  there  are: 
eight  performance  requirements  stated  in  *'he  DCP;  2S0  in  the  "Materiel 
Need"  (MN),  which  is  the  main  document  (together  with  the  development 
plan)  that  will  guide  the  program  manager;  approximately  400  in  the 
RFP  (e.g.,  in  the  kFP  rhere  are  three  specif irat ions  asscx  iated  with 
the  IK  detector  of  the  copilot  -gunner 's  FUR,  while  the  dete>  tor  is 
subsumed  as  part  of  the  spc  ified  FUR  in  the  MNl;  and  an  as  yet  un¬ 
known  but  larger  numl>er  of  specif  i<  at  ions  that  will  appear  at  the 
detailed  implementation  level.  In  approving  a  program  for  a  ma.'or 


TABLE  III-22.  TYPICAL  REQUIREMENTS  PYRAMID 


Number  of  Requirements/ 

Level  Specifications  Explicitly  Expressed 


Top  System  Decision  Level 
Requirement  Statement 
RFP 

Detailed  Implementation 


Order  of  10 

2 

Order  of  10 
Order  of  K  x  10 2 
Order  of  10^ 


TABLE  III-23.  QUESTIONS  TO  BE  ANSWERED  ABOUT  ELECTRONIC 
SYSTEMS  AND  SUBSYSTEMS  DURING  MANAGEMENT  REVIEW 

•  What  components  exist? 

•  What  components  need  new  development? 

•  What  is  the  development /test  status  of  existing  components? 

•  Are  new  technologies  involved?  If  so,  which,  and  what  is 
their  status? 

•  Have  the  components  previously  been  integrated  into  a  subsystem? 

•  If  so,  has  it  been  operated  outside  the  laboratory? 

•  Has  there  been  subsystem  OTEE? 

•  How  do  results  compare  with  requirement? 

•  What  are  the  specific  interface  problems  with  other  subsystems? 

•  What  are  the  cost,  performance,  and  schedule  implications  of 
resolving  those  problems  in  this  new  development  ? 

•  What  are  the  options  if  there  is  excess  cost  growth? 

a)  Alternative  components/subsystems? 

b)  Let  cost  grow? 

c)  Reduce  performance  requirement? 

d)  Reduce  force? 

e)  Find  another  way  to  do  the  job? 
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system,  the  DSARC  and  comparable  Service  bodies  may  not  be  aware  of 
lower-level  requirements  statements,*  which  can  later  make  the  cost 
"designed  to"  difficult  to  hold. 

The  cases  of  the  AH- 56  fire  control  system  and  potential 
problems  in  fitting  capability  of  the  PAVE  SPIKE  type  to  the  A- 7  and 
the  A- 10  illustrate  the  potential  effects  on  cost  of  failure  to  plan 
well  in  advance  for  incorporation  of  new  technology  in  an  existing 
system  or  a  new  system.  This  need  is  consistent  with  the  idea  of  evo¬ 
lutionary  development.  The  point  is  not  that  new  technology  should 
not  be  adopted  as  it  becomes  available,  but  rather  that  it  should  be 
adopted  in  an  orderly  manner  after  careful  development  with  a  system 
application  in  view. 

Table  III-23  lists  a  series  of  questions  about  electronic 
subsystems  that  can  assist,  during  management  review  (at  Service  or 
OSD  level,  and  in  connection  with  broad  reviews  based  on  the  DCP), 
in  eliciting  a  priori  the  sources  of  potential  cost  growth  without 
requiring  high-level  management  to  learn  all  the  details  of  proposed 
system  requirements  and  plans  (although  a  review  in  detail  by  support¬ 
ing  staff  would  obviously  be  necessary).  The  questions  synthesize 
and  reflect  the  requirement  and  uncertainty  problems  of  major  subsystems 
that  emerged  from  the  examples  examined  in  Appendix  C.  As  shown  in 
Table  III-24,  the  answers  to  these  questions  can  indicate  in  straight¬ 
forward  fashion  the  degree  of  risk  involved  in  undertaking  a  develop¬ 
ment.  This  understanding  can  then  help  in  establishing  where  in  the 
uncertainty  range  the  cost  designed  to  and  the  performance  figures 
should  be  set;  it  can  help  in  assessing  the  risks  attending  approval 
of  development;  and  it  can  help  in  making  the  judgment  of  potential 
worth  of  the  development  in  light  of  the  risks  of  cost  growth  poten¬ 
tially  incurred. 

*For  example,  failure  in  the  MN  to  specify  weather  and  detection 
probability  for  a  day-night  sight  (as  happened  in  the  AAH  program) 
may  result  in  overdesign  of  a  system  to  meet  the  worst  conditions. 

Note  also  the  original  performance  specification  for  the  navigation 
system  of  the  C-5A. 
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TABLE  III -24.  HIGHLY  SIMPLIFIED  EXAMPLES  OF  RISK 

ASSOCIATED  WITH  SOME  POSSIBLE  ANSWERS 
TO  QUESTIONS  IN  TABLE  III -23 


Answers 

Questions 

High-Risk 

Medium-Risk 

Low-Risk 

What  omponents  exist? 

None 

lew  (named) 

All 

Whet  components  need  new  development; 

All 

Tew  ( named ) 

None 

Whet  is  the  development/test  stetus  oi  existing 
opponents? 

!m*I  ratory 

Developed,  not 
produced 

Developed,  not 
produt  ed 

Are  new  technologies  Involved;  It  .c,  which, 
end  whet  is  their  stetus; 

yes 

No 

No 

Ha.e  the  components  previou.sly  beer  integrated 
into  a  subsystem: 

NO 

Partially 

Yes 

I!  so,  ha  it  beer,  operate]  outside  the 
laboratory? 

No 

Tic  Id  test 

f  ield  test 

Has  there  been  subsystem  CT'E; 

No 

Fart  ial 

Yes 

How  do  results  ompare  with  requirement? 

— 

Part ia 1 lyd 

Well* 

Whet  ere  the  specific  interface  problems  with 
other  subsystems? 

All  (named) 

All  (  named ) 

Tea  ( naiM-d) 

What  ere  the  cost,  performance,  and  schedule 
implications  of  resolving  those  problems  in 
this  new  development? 

Moderate  t 
high* 

Moierdt*-4 

IsW* 

•  Mhet  are  the  options  it  there  is  eacess  cost 

grcwtfer. 


a) 

Alternat  i  .m  (mponents/subsyvtemv . 

None 

Yes 

Yes 

b) 

Let  ost  gr'W. 

Yes 

Yes 

— 

c) 

Redu  e  per  toman  e  requirement; 

Yes 

Yes 

— 

d) 

Red  i  e  t'-rce? 

Yes 

Yes 

r’et 

e) 

Tind  another  way  t,  do  *he  lot. 

N<  ne 

Nore 

e  eral 

;sr 

<* 


f«ased  on  numbers  gi  er  , 


iso 


J 


> 
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c.  Other  Management  Problems  in  Implementation.  Section  III -A, 
on  cost  uncertainty,  has  shown  that  costs  are  likely  to  be  under¬ 
estimated  at  the  inception  of  development.  Important  causes  have 
been  illustrated  in  Figs.  III-ll  and  III-12  and  in  Table  III-22  and 
have  been  discussed.  As  indicated  in  Section  III-B-2,  the  decision 
to  establish  a  requirement  involves  a  value  judgment,  usually  supported 
by  analysis,  that  anticipated  costs  are  worth  incurring  to  meet  an 
anticipated  threat  or  need.  This  judgment  might  be  made  differently 
if  the  true  cost  were  appreciated  at  the  outset.  Alternatively,  if 
cost  growth  were  sensed  early  after  a  development  began  and  adjust¬ 
ments  were  made  in  expected  performance,  as  shown  by  the  alternate 
development  path  in  Fig.  III-13,  cost  growth  might  be  smaller  but 
so  would  the  performance  achieved.  This,  too,  might  lead  to  a  different 
judgment  of  need  if  anticipated  at  the  time  of  the  requirement  decision. 

This  suggests  an  iterative  decision  process,  as  experience 
is  gained  in  development  and  leads  to  a  continually  improving  view 
of  the  performance,  schedule,  force  size,  and  cost  that  will  actually 
be  achieved.  Although  sunk  cost  and  time  lost  must  be  allowed  for 
in  deciding  whether  to  proceed  further  at  any  point,  it  is  clear 
that  the  value  of  the  "required"  system  is  always  implicitly  (if  not 
explicitly)  in  question  as  its  requirement  parameters  change.  In 
many  cases,  there  will  be  (or  could  be)  an  existing  system  (with 
potential  improvements)  to  fall  back  on,  thereby  continuing  the  com¬ 
petition  between  development  alternatives  from  the  initial  requirement 
decision  through  development.  This  continuing  review  can  take  place 
within  the  developing  Service,  between  the  Service  and  OSD,  or  both. 

It  is  apparent  that  if  the  DOD  is  to  retain  the  flexibility 
to  change  systems  as  a  result  of  this  iteration  of  requirements  review, 
the  development  contract  structure  must  permit  such  changes,  balancing 
equity  for  the  contractor  in  recovering  costs  against  the  Government’s 
need  to  change  direction  without  excessive  penalty.  The  examples  of 
the  Mark  II  avionics  and  the  C-BA  navigation  subsystem  illustrate 
that  the  Government  can  become  looked  into  a  contract  that  makes  c hange 


COST 


FIGURE  111-13.  Potential  Effect  of  Iterating  Requirements  Review 
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expensive,  even  when  one  can  predict  with  reasonable  certainty  that 
there  will  be  undesirable  cost  growth  under  the  contract  as  written. 

4.  Classification  of  Electronic  Systems  for  Management 

There  are  clearly  differences  in  the  electronic  content,  purposes, 
and  management  problems  of  various  system  and  subsystem  acquisitions. 
These  differences  require  differing  treatment  in  acquisition  manage¬ 
ment.  Further,  systems  and  subsystems  can  be  aggregated  into  a 
small  number  of  groupings  such  that  the  systems  in  each  may  be  treated 
similarly. 

A  natural  division  occurs  between  systems  that  are  large  enough 

to  qualify  for  review  by  DSARC  criteria*  and  systems  that  are  not. 

Within  the  former  group,  some  (such  as  command-control,  electronic 

warfare,  or  large-scale  communications  systems)  are  primarily  electronic, 

while  others  (such  as  fighter  aircraft,  tanks,  or  ships)  have  major 

electronic  subsystems  that  are  developed  as  parts  of  the  total  systems. 

Some  systems,  such  as  missiles,  can  fall  into  either  category. 

Table  III-25  lists  examples  of  systems  of  both  kinds  and  of  missile 

systems  as  well,  and  it  shows  also  the  estimated  percentages  of  the 

22 

costs  of  system  development  devoted  to  electronics.  Inspection  of 
these  examples  discloses  a  useful  subdivision  between  systems  for 
which  the  electronic  portion  of  costs  (RDT&E,  or  total  acquisition, 
or  both)  is  50  percent  or  greater,  and  those  for  which  the  electronics 
cost  is  less  than  50  percent  but  greater  than  10  percent. 

Electronic  systems  and  equipment  below  the  DSARC  threshold  also 
appear  to  fall  into  two  major  groups.  One  includes  subsystems  being 
independently  developed  for  inclusion  in  major  systems  (such  as  LORAN-D 
or  PAVE  SPIKE);  the  other  includes  electronic  systems  and  devices 
designed  for  specific  direct  applications,  such  as  Army  field  radios 
or  night -vision  devices.  While  major  systems  (by  DSARC  criteria)  are 


*A  "major"  system  is  defined  by  any  or  all  of  the  following:  •  $50 
million  RDT&E;  $200  million  procurement;  and  national  urgency. 
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TABLE  III-25.  ELECTRONICS  PERCENTAGES  OF  RDT&E  COSTS 
OF  SOME  MAJOR  SYSTEMS 


Systems  Primarily  Electronic 

Submarine  Sonar  AN/BQQ-5  (Navy) 

SATCOM  (Army) 

TACFIRE  (Army) 

VAST  (Navy) 

SATCOM  (Navy) 

ABNCP  (Air  Force) 

AWACS  (Air  Force) 

E-2C  (Navy) 

Systems  Having  Major  Electronic  Subsystems 

XM-1  (Army) 

AAH  (Army) 

F-14  (Navy) 

F-15  (Navy) 

F-4  (Air  Force) 

B-l  (Air  Force) 

UTTAS  (Army) 

Missile  Systems 

AIM-9  (Navy) 

PHOENIX  (Navy) 

CONDOR  (Navy) 

SAM-D  (Army) 

DRAGON  (Army) 

LANCE  (Army) 

aSourc:e:  Ref.  22. 

*  Depends  on  version. 

Part  of  PHOENIX  cost  is  in  F-14  program. 


Electronics 
Cost  Percentage3 

100% 

90 

90 

90 

30 

50 

50 

50 


25-40% 

20-30 

20-25 

18-22 

15-20 

10-15 

10 


40-B0%b 

n 

50 

40-50 

40-50 


20 
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usually  each  assigned  a  single  line  item  in  the  budgeting  process, 
smaller  developments  in  a  related  applications  area  are  grouped 
within  a  single  line  item.  Table  III-26  illustrates  such  aggregations 
The  significance  for  program  review  is,  of  course,  that  developments 
or  procurements  of  the  kind  illustrated  in  Table  III-26  must  be  identi 
fied  individually  rather  than  by  line  item. 

From  the  above  considerations,  the  following  electronic  system 
classification  is  suggested  for  purposes  of  acquisition  management: 


Class  I: 

Class  II: 


Class  III: 


Class  IV: 


Major  systems  by  DSARC  criteria,  50  percent  or  more 
of  whose  cost  is  in  electronics. 

Electronic  subsystems  of  major  (DSARC)  systems, 
representing  10  percent  or  more  of  total  system 
cost,  and  included  within  and  scheduled  with  the 
major  system  acquisition. 

Electronic  subsystems,  multipurpose  in  character, 
developed  independently  for  use  in  many  major  systems 
and  themselves  below  the  criteria  for  major  systems. 
Other  electronic  systems  and  devices,  below  DSARC 
criteria,  that  do  not  fall  into  any  of  the  above 
categories . 


Review  of  the  systems  in  the  FYDP  shows  a  distribution  of  numbers  of 
separate  developments  falling  into  the  above  categories  as  listed 
in  Table  III-27.  The  assignments  to  the  different  classes  are,  in 
this  case,  largely  judgmental,  for  purposes  of  illustration.  If 
there  were  interest  in  this  classification  system,  final  assignment 
would  have  to  be  made  by  DOD  according  to  its  own  management  judgment. 
Class  I  and  Class  II  categorization  would  appear  "cut  and  dried,"  by 
the  definitions;  the  major  difficulties  would  be  in  determining  the 
fraction  of  system  cost  devoted  to  electronics  and  in  defining  the 
electronic  subsystems  appropriately.  The  problem  of  establishing 
criteria  to  identify  Class  III  and  Class  IV  systems  for  particular 
management  attention  will  be  discussed  below  in  the  context  of  manage¬ 
ment  options  for  improved  control  of  system  costs. 
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TABLE  III-26.  TYPICAL  LINE-ITEM  BREAKDOWN  EOT  INDEPENDENT 

SUBSYSTEM  DEVELOPMENTS3 


Program  Element  6.3206N,  Airborne 
Electronic  Warfare  Equipment, 

Ind  ides : _ 

W3311  -  Airborne  Defensive  CM 

W3312  -  Airborne  Infrared  CM 

W3344  -  Expendable  Jammer 

W3351  -  Integrated  Tactical  PCM 

W3355  -  Visual  CM 

W3360  -  Tail  Warning/ 

Communications  Jamming 

W3361  -  Sup.  Bandwidth/Dual-Mode 
DECM 


Program  Element  D.3202N,  Avioni-  s 
Inc  ludes : 


W3150  -  All-Application  .Digital 
Computer 

W3342  -  Advanced  AEW  Radar 

W3415  -  Carrier  Aircraft  ]rier*ial 
Navigat ion 

W4SX1  -  Advanf  ed  Aire  raft  Pie  tri 
c al  System 


aSource:  Ref.  23. 

TABLE  III-27.  APPROXIMATE  NUMBERS  OF  PROGRAMS ,  BY  CLASS 


Class 

Category 

Electronic 

System 

Classification 

Estimated 
Number  of 
Programs 

I 

Major  Electronic  Systems 

Electronics 
>  50n  of  total 
system  cost 

23 

II 

Major  Systems  with  Important 
Electronic  Subsystems 

Electronic s 
<  50/'  of  total 
system  cost 

75 

III 

Independently  Developed 
Electronic  Subsystems 
for  Major  Systems 

Separate 

Electronic 

Subsystems 

500-1,000 

IV 

Electronic  Equipment 
and  Support 

All  Other 
Acquisit ion 

1,000-10,000 
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A  breakdown  of  the  DOD  systems  acquisition  budget  for  FY  1974 
(taken  as  reasonably  typical  for  the  present)  is  shown  in  Fig.  III-14. 
While  there  is  considerable  uncertainty  in  the  estimates  of  the 
electronic  content  of  the  various  classes  of  system,  some  interesting 
and  useful  conclusions  can  be  drawn  from  the  figure.  Of  the  $21.9 
billion  FY  1974  total  acquisition  budget,  some  85  percent,  or  $18.7 
billion,  is  estimated  to  be  devoted  to  systems  having  significant 
electronic  content  (i.e.,  electronic  subsystems  costing  10  percent 
or  more  of  total  system  cost).  Top-level  management  attention  to 
Class  I  and  II  systems,  already  institutionalized  through  the  DSARC 
and  its  Service  counterparts,  ensures  such  attention  to  about  70 
percent  of  the  $18.7  billion;  if  intensified  attention  is  given  to 
the  electronic  components  of  these  systems,  which  could  drive  costs 
and  without  which  the  systems  could  not  operate  effectively,  35-50 
percent  of  the  electronic  acquisition  budget  would  be  affected. 

Class  III  systems,  taken  as  essentially  all  electronic,  are  least 
certain  in  definition  as  a  class,  but  involve  a  large  fraction  of 
the  electronic  acquisition  budget— 30-50  percent.  This  amounts  to 
only  12-20  percent  of  the  total  acquisition  budget,  however.  Class  IV 
acquisitions,  although  many  in  number,  represent  the  smallest  fraction 
of  either  the  total  or  the  electronics  acquisition  budget. 

5.  Options  for  Management  Control  of  Electronics  Acquisitions 

A  few  broad  types  of  management  action  by  OSD  and  the  Services 
might  be  of  assistance  in  reducing  the  cost  of  electronic  system  ac¬ 
quisition  through  the  requirements  and  associated  review  processes. 
These  include: 

1.  Improving  the  electronic  components  of  existing-generation 
systems  rather  than  acquiring  wholly  new-generation  systems, 
whenever  this  can  be  done  within  the  uncertainty  bounds  of 
threat  or  need. 

2.  Decoupling  electronic  development  schedules  from  platform 
development  schedules ,  where  the  two  are  separable ,  and 
incorporating  new  electronic  systems  only  when  reliability 
is  proven. 

*  157 


TOTAL  SYSTEM  ACQUISITION  BUDGET,  S10 


SUBSYSTEMS  DEVELOPMENT 

(••  io°a 


FIGURE  111-14.  FY  1974  DOD  Acquisition  Budget  (R&D  and  Ptocurement),  by  Class 
of  System 
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3.  Improving  the  visibility,  to  top  management,  of  potentially 
cost-driving  electronic  subsystems  of  major  systems,  before 
requirements  are  established. 

4.  Allowing  for  technological  and  cost  uncertainties  in  es¬ 
tablishing  cost,  performance,  and  schedule  requirements. 

5.  Iterating  user-producer  interaction  and  requirement  review 
as  experience  is  gained  during  development  and  initial 
production. 

To  implement  these  principles,  the  four  classes  of  system  must  be 
treated  differently.  Table  HI-28  shows  that  the  principles  do  not 
apply  to  each  class  of  system  in  the  same  way.  Further,  review  and 
approval  of  the  kind  and  at  the  level  applied  to  electronics  of 
Classes  I  and  II  cannot  be  applied  to  electronics  of  Classes  III 
and  IV,  simply  because  of  the  much  larger  numbers  of  developments 
and  procurements  involved.  The  OSD  and  the  Services  can  best  pre¬ 
scribe  the  approaches  that  appear  most  feasible  for  implementation. 
Six  possible  options,  oriented  toward  a  better  focus  of  management 
attention  on  specific  problem  areas  by  the  established  review  and 
decision  mechanisms  rather  than  by  expansion  or  drastic  change  of 
those  mechanisms ,  are  as  follows ; 

1.  Since  the  appropriate  responsibilities  and  authorities  are 
already  assigned  in  the  OSD  and  the  Services,  internal 
guidance  can  simply  be  issued  to  give  increased  attention 
to  these  points.  In  particular,  answers  to  the  kinds  of 
question  listed  in  Table  III-23,  regarding  the  primary 
electronics  of  Class  I  systems,  the  major  subsystems  of 
Class  II,  and  the  potential  developments  of  Classes  III  and 
IV,  would  assist  in  assessing  the  risk  and  the  nature  of 
the  uncertainties  involved. 

2.  For  major  systems,  the  DSARC  and  its  counterparts  in  the 
Services  can  require  explicit  answers  to  such  questions, 
either  as  part  of  the  supporting  staff  work  prior  to  de¬ 
cision,  or  as  part  of  brief  sections  in  or  annexes  to  the 
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TABLE  III -28.  APPLICABILITY  OF  POTENTIAL  MANAGEMENT  ACTIONS, 
BY  CLASS  OF  SYSTEM 


Potential  Management 
Action 

Applicability  of  Action 

Class  1 

Class  IT 

Class  ill 

Class  T 

1.  Improvement  of 
electronic  compo¬ 
nents/subsystems 
within  system 
generation 

Yesa 

Yes 

Yes,  class 

supports 

action 

Class  con¬ 
sists  of  com¬ 
ponents  or 
devices  for 
independent 
use 

2.  Decoupling  of 
development  and 

TOC  schedules  for 
platform  and 
electronics 

Yesb 

Yes 

Yes , 
implicit 

Class  con¬ 
sists  of  com¬ 
ponents  or 
devices  for 
independent 
use 

3.  Improvement  of 
visibility,  to 
management,  of 
potentially  cost¬ 
driving  sub¬ 
systems  of  major 
systems 

Yes 

Yes 

Management 
level  must 
be  lower 
than  DSARC 
or  its 
equivalent 
in  Services 

Must  be  at 
lower  level 
and  selec¬ 
tive 

4.  Allowance  for 
technological 
and  cost  un¬ 
certainties 

Yes 

Yes 

Yes 

Yes 

5  Iteration  for 
usei  -producer 
requirement 
review 

Yes 

Yes 

Yes 

Yes 

a. 

Applies  primarily  to  components  if  system  is 
bIn  many  cases,  platform  exists  only  to  carry 


almost  wholly  electronic, 
electronics . 


1G0 


DCP.  This  would  require  that  the  DCP  identify  the  key  elec¬ 
tronic  subsystems  (see  option  6,  below). 

Since  the  DSARC  and  comparable  bodies  do  not  ordinarily  re¬ 
view  acquisitions  of  Classes  TTI  and  IV,  it  may  be  considered 
desirable  to  establish  similar  panels  at  lower  levels  of 
management  in  the  OSD  and  the  Services  for  this  purpose. 

Since  review  already  takes  place  in  individual  offices 
(e.g.,  R&D,  I&L,  comptroller),  this  would  simply  increase 
coordination  of  such  reviews.  The  large  number  of  Class  III 
and  Class  IV  acquisitions  suggests  the  necessity  for  es¬ 
tablishing  threshold  criteria  for  such  review,  at  least  for 
Class  III.  Examination  of  line  items  such  as  those  in 
Table  III-26  indicates  that  levels  such  as  $10  million 
RDT&E  or  $50  million  procurement  might  be  appropriate,  but 
a  final  determination  would  depend  on  careful  analysis  of 
the  budget  and  project  structure  to  limit  the  number  of 
systems  above  threshold  to  something  manageable.  These 
systems  would  be  treated  in  this  form  much  as  major  systems 
are  treated. 

24 

The  DDR&E  Advisory  Group  on  Electronic  Devices  (AGED) 
has  been  effective  in  advising  on  research  in  its  areas  of 
responsibility.  A  parallel  group  for  systems  could  be  es¬ 
tablished  to  advise  on  the  problems  of  the  large  number  of 
Class  IV  acquisitions. 

To  ensure  iteration  of  requirements  decisions  and  value 
judgments  as  development  experience  is  gained,  thresholds 
of  departure  from  the  initial  requirement  could  be  estab¬ 
lished,  beyond  which  mandatory  review  by  the  cognizant 
Service  or  OSD  (as  appropriate)  would  be  required.  The 
DSARC  or  other  cognizant  OSD  office  would  be  kept  informed 
when  the  Services  undertake  such  reviews.  The  thresholds 
established  could  still  permit  requisite  latitude  for  change 
on  the  part  of  the  program  manager — they  might  allow,  for 
example,  any  or  all  of:  10  percent  development  or  production 
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cost  increase;  10  percent  reduction  of  specified  performance 
parameters;  and  IOC  delay  of  a  year.  The  key  questions  in 
subsequent  review  would  be:  whether  the  departures  noted 
presaged  further  departure  from  the  initial  requirement; 
how  much;  and  whether,  in  view  of  these  changes,  the  formal 
requirement  should  continue  to  exist,  or  whether  develop¬ 
ment  should  be  stopped  or  redirected. 

6.  Since  it  is  difficult  for  top-level  management  to  monitor  the 
details  of  a  process  as  complex  as  that  attending  the  estab¬ 
lishment  of  requirements  and  the  approval  of  acquisitions, 
the  OSD  and  the  Services  may  find  it  desirable  to  bring  the 
responsibility  and  authority  associated  with  the  important 
aspects  of  such  monitoring  into  better  focus.  This  could, 
for  example,  be  accomplished  by  an  office  or  an  individual 
responsible  for  obtaining  agreement  on  definition  of  electronic 
subsystems  to  be  singled  out  for  special  attention,  and  for 
making  certain  that  the  need  for  reviews  such  as  those  dis¬ 
cussed  under  option  5,  above,  is  brought  to  appropriate 
management  attention.  This  point  of  responsibility  could 
also  be  alert  for  opportunities  to  consolidate  like  sub¬ 
system  or  equipment  requirements  for  several  systems. 

It  should  be  noted  that  these  suggested  options  for  closer  management 
attention  to  electronic  systems  apply  to  intended  acquisitions  only — 
those  systems  that  are  to  be  procured  or  that  enter  development  with 
relatively  firm  procurement  plans  in  view  [in  DOD  terms,  the  sequence 
from  advanced  development  (6.3B)  through  engineering  development 
(6. 4) /ope rational  systems  development  (6.6)].  Many  systems  or  com¬ 
ponents  may  enter  exploratory  development  (6.2)  or  advanced  develop¬ 
ment  (6.3A)  with  the  idea  of  developing  technology  or  testing  feasi¬ 
bility.  Too-tight  management  control  in  these  phases  is  undesirable 
if  it  will  stifle  initiative  that  may  make  new  kinds  of  systems 
available. 
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6.  findings  and  Recommendations 
a.  Findings 

•  A  requirement  for  a  system  or  subsystem  may  be  defined  as 
including  performance,  physical  characteristics,  cost, 
quantity,  and  schedule — all  in  conformity  with  a  statement 
of  threat  or  need.  While  the  overall  requirements  and 
acquisition  decision  process  includes  attention  to  all 
these  components,  the  current  approach  to  establishing  a 
requirement  tends  to  start  with  desired  performance  and 
characteristics.  Cost,  quantity,  and  schedule  are  modifiers, 
added  later.  Thus,  requirements  tend  to  be  performance- 
driven,  with  inadequate  early  consideration  of  pragmatic 
essentials . 

•  The  requirements  and  acquisition  decision  process  includes, 
at  least  formally,  the  attributes  necessary  for  effective 
management  of  system  acquisition.  In  actual  implementation, 
however,  cost-driving  aberrations  of  the  process  occur  at 
several  stages:  in  establishing  the  original  requirement 
and  in  expanding  it  into  system  characteristics  and  specifi¬ 
cations;  in  the  interactions  between  management  practices 
and  advanced  technology;  in  cost  estimating;  and  in  con¬ 
tracting  practices. 

•  Costs  of  progressions  of  wholly  new-generation  weapons 
systems  have  increased  much  faster  than  costs  of  progres¬ 
sions  of  product -improved  systems,  even  when  the  product 
improvements  have  involved  incorporation  of  new  generations 
of  electronic  subsystems.  This  suggests  that  cost  savings 
would  result  if,  in  establishing  requirements,  within- 
generation  system  improvements  were  favored  over  totally 
new-generation  developments,  where  that  is  feasible  within 
the  uncertainties  of  threat  or  need.  The  additional  costs 
of  new-generation  systems  appear  to  arise  partly  from  trying 
to  drive  new  vehicle,  engine,  and  electronics  developments 
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all  to  the  same  schedule,  and  partly  from  the  engineering 
difficulties  in  achieving  compatibility  among  all  three 
when  none  of  them  is  yet  defined  well  enough  to  permit 
prediction  of  the  interactions  when  they  are  combined. 

This  suggests  that  cost  savings  could  be  achieved  if 
electronics  IOCs  wene  established  separately  and  independently 
of  vehicle  IOCs,  when  feasible,  and  the  electronic  subsystems 
were  independently  developed.  The  specification  of  form, 
fit  (interface),  and  function  requirements  for  the  elec¬ 
tronics  is  essential  to  such  independent  development.  In¬ 
dependent  development  would  make  possible  the  consolidation 
of  requirements  for  like  electronic  subsystems  and  equipment 
and  would  broaden  the  applicability  of  specific  designs 
to  several  systems. 

•  Other  important  aberrations  of  the  requirements  process 
leading  to  cost  growth  include:  selection  of  desired  op¬ 
erating  points  too  high  on  the  cost -performance  curve; 
failure  to  allow  for  uncertainty  in  selecting  the  operating 
point;  cascading  of  detailed  requirements  between  the  de¬ 
cision  and  detailed  implementation  levels;  and  failure  to 
iterate  requirements  decisions  as  development  experience 

is  gained. 

•  There  is  insufficient  visibility,  at  top  management  levels, 
of  potentially  cost-driving  electronic  subsystem  problems. 

b.  Recommendat ions 

•kirk  In  exploring  and  establishing  a  system  requirement,  give 
performance,  physical  characteristics,  cost,  quantity,  and 
schedule  equal  status  from  the  beginning,  and  perform  trade¬ 
offs  among  these  early  in  the  game. 

★★★  In  major  system  developments,  separate  vehicle  IOCs  and 
electronic  subsystem  IOCs  where  possible,  and  develop  the 

★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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electronics  independently.  Consolidate  like  subsystem  or 
equipment  requirements  wherever  feasible. 

Increase  visibility  to  top-level  management  of  potentially 
cost-driving  developments  of  electronic  subsystems  associated 
with  major  systems  by  instituting  suitable  review  prior  to 
each  DSARC  review.  As  appropriate,  provide  for  a  similar 
visibility  to  management  of  developments  of  less-than-major 
electronic  subsystems  and  equipments  by  refocusing  reviews 
to  make  them  analogous  to  DSARC  review,  but  at  lower  manage¬ 
ment  levels. 

irtrk  Give  increased  consideration  to  product- improvement  programs 
as  a  means  of  fulfilling  new  requirements,  as  opposed  to 
institution  of  wholly  new  development  programs. 

Select  technology  and  performance  objectives  for  new  de¬ 
velopments  conservatively  (i.e.,  low  on  the  cost-performance 
curve),  except  in  cases  where  military  necessity  imposes 
an  overriding  need  for  risk-taking  to  achieve  extremes  of 
performance.  Allow  for  uncertainty  in  establishing  the 
corresponding  system  requirements. 

irtrk  Iterate  requirement  and  acquisition  decisions  if  performance, 
characteristics,  cost,  quantity,  or  schedule  depart  signifi¬ 
cantly  from  initial  plans  during  development.  Establish 
criteria  to  trigger  such  iteration. 

-  Wherever  possible  in  light  of  threat  or  need  uncertainties, 
intensify  the  practice  of  choosing  within-generation  system 
improvements  in  preference  to  wholly  new-generation  system 
developments . 

-  Make  certain  that  contract  structures  neither  inhibit 
tradeoffs  by  the  DOD  between  cost  and  other  requirements 
components  nor  drive  cost -increasing  requirements  when  that 
in  unintended. 


■kick  Highest  priority;  kk  high  priority;  k  priority. 
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Some  potential  management  options  for  implementation  of  the  above 

<* 

have  been  discussed  in  Section  III-B-5.  These  involve:  issuance  of 
additional  management  guidance;  provision  of  subsystem  information 
in  conjunction  with  the  DCP/DSARC  process;  focusing  of  review  of  ^ 

less -than -major  systems,  and  appropriate  management  arrangements  for 
such  review;  establishing  thresholds  of  departure  from  planned  re-  •«. 

quirements  and  iterating  the  requirements  review  in  case  of  such 
departure;  and  focusing  authority  and  responsibility  to  help  ensure 
adherence  to  the  new  guidance  and  procedures. 
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C.  DESIGN  TO  COST 


Poor  man 3  said  It  you  pay  too  much  for  your  uhistle. 

--Benjamin  Franklin 


1.  Initiation  of  the  Concept 

DOD  Directive  5000.1^  established  the  current  broad  policy  on  pro¬ 
cedures  to  control  costs  of  major  systems  acquisitions.  The  Services 

subsequently  published  their  own  guidance  letters  regarding  cost  control 
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m  system  development  and  acquisition.  The  Army  covered  the  concept  m 

some  detail  while  the  Air  Force  and  Navy  described  it  in  more  general 

terms.  In  view  of  the  known  successful  implementation  of  design- to-cost 

procedures  in  the  commercial  sector,  the  broad  policy  guidelines  could  be 

considered  sufficient  to  permit  each  Service  to  embark  upon  procurements 

embodying  design-to-cost  principles.  Dr.  John  S.  Foster,  Jr.,  then 
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Director  of  Defense  Research  and  Engineering,  in  an  address  before  the 
National  Security  Industrial  Association  on  March  12,  1970,  described  the 
new  approaches  to  be  taken  to  tb'  procuiement  of  new  weapons  systems. 
Where  heretofore  performance  at  .  ny  cost  might  have  dominated  the  systems 
acquisition  process,  it  must  now  be  realized  "...that  price  has  as  much 
priority  as  performance."  It  would,  therefore,  be  necessary  "...to  make 
cost  a  principal  design  parameter."  Since  that  time  the  concept  has 
undergone  further  evolution,  and  it  has  been  more  firmly  adopted  as  a 
basic  precept  of  the  DOD  weapons  systems  acquisition  process. 

While  the  design- to-cost  (DTC)  concept  had,  and  retains,  some  ambigu¬ 
ities,  it  includes  the  following  basic  practices  and  procedures: 

> 

1.  Cost  should  consciously  be  made  a  design  parameter,  equal  in 

> 

status  to  performance  and  other  system  specif ications . 

f 

2.  ice  can  and  wilL  be  given  up  and  IOC  will  be  deferred, 

* 

wi thin  limits,  if  necessary  to  hold  cost  down. 

A  DTC  goal  or  target  should  be  designated  early  in  the  acquisi- 
k 

tion  cycle,  preferably  prior  to  the  beginning  of  the  development 
effort  or  very  shortly  thereafter. 

¥ 
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4.  Competition  should  be  incorporated  and  maintained  up  to  and, 
where  feasible,  through  production,  as  a  means  of  holding  costs 
down  and  holding  open  the  Government's  options  to  acquire  lower- 
cost  equipment. 

5.  DTC  performance  should  be  monitored  throughout  the  acquisition 
cycle,  to  ensure  timely  visibility  of  significant  variations 
from  target  costs  and  performance. 

What  cost  is  meant  in  the  DTC  concept?  Most  often,  the  meaning  has 

been  taken  to  be  unit  production  cost.  Rf>D  might  be  increased  to  achieve 
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lower  unit  production  cost.  The  cost  target  can  also  be  unit  f lyaway 
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cost  (and  is  so  specified  in  a  memorandum  on  the  subject  from  the  Deputy 
Secretary  of  Defense),  program  cost,  or  life-cycle  cost,  which  can  be  de¬ 
fined  in  various  ways.  Life-cycle  cost  is,  in  view  of  the  uncertainties 
discussed  in  Section  III-A,  extremely  difficult  to  forecast  or  even  to 
estimate  a  posteriori.  The  use  of  warranties  or  other  forms  of  contractor 
maintenance,  where  feasible,  would,  as  discussed  in  Section  IV-A,  give  a 
firmer  estimate  for  the  bulk  of  the  life-cycle  costs  from  development 
through  maintenance,  the  remaining  uncertainties  being  associated  with  the 
Government's  administration  and  management  costs  and  some  operational 
costs . 

The  establishment  of  a  cost  target  for  any  system  is,  as  yet,  an  un¬ 
certain  procedure.  It  involves  implicit  or  explicit  assessments  of  the 
value  of  spending  a  certain  amount  of  money  to  achieve  a  certain  perform¬ 
ance.  Comparison  with  a  civilian  equivalent  of  the  equipment,  where  pos¬ 
sible,  may  help  establish  a  reasonable  cost  goal.  In  other  cases,  it  has 
been  possible  for  DOD  to  work  with  industry  via  the  proposal  process  to 
ascertain  likely  magnitudes  of  cost  to  achieve  desired  performance. 
Finally,  in  many  cases,  all  judgments  and  experience  appear  to  join  in  a 
consensus  that  some  selected  cost  goal  for  a  system  appears  reasonable,  or 
is  of  an  "acceptable"  magnitude. 

2 .  Potential  Problems  in  Design- to-Cost 

Several  recent  analyses  have  pointed  out  the  difficulties  that  may 
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be  encountered  in  DTC.  Some  of  them  are  worth  enumerating  briefly,  as 


background  for  consideration  of  DTC  efforts  by  the  Services  in  the  elec¬ 
tronic  subsystem  area. 

The  key  problem,  interacting  with  the  difficulty  of  establishing  a 
reasonable  cost  a  priori,  derives  from  the  concept  of  reducing  perform¬ 
ance  requirements,  if  necessary,  to  achieve  a  desired  cost.  Performance 
requirements  can  obviously  be  reduced  to  the  point  of  unacceptability. 
Since  the  validity  of  the  target  cost  is  initially  uncertain,  the  target 
cost  cannot  necessarily  be  held  sacrosanct  over  all  other  design  param¬ 
eters.  Thus,  the  flexibility  to  let  cost  increase  or  to  let  schedule 
slip  is  also  required.  The  choice  of  performance  goals  high  on  the  cost- 
performance  curve  (Fig.  Ill- 11,  p.  145),  which  is  frequent  for  defense 
systems,  reinforces  this  need.  Additional  related  difficulties  include: 
inability  to  specify  the  size  of  buy  early  enough  to  allow  contractors  to 
make  an  accurate  estimate  of  costs;  the  requirements  pyramid  (Table  HI- 
22,  p.  148)  and  the  hidden  potential  costs  it  implies;  inhibition  of  the 
program  manager  in  making  tradeoffs  on  performance  specifications  con¬ 
sidered  mission-critical;  inhibition  of  the  contractor  in  arriving  at  an 
optimum  design  because  of  overconstraining  specifications;  and  diffi¬ 
culties  arising  from  the  contracting  process. 

Within  the  ASPR,  this  investigation  has  found,  there  are  no  specific 
constraints  that  need  inhibit  the  flexibility  necessary  to  achieve  DTC 
goals.  However,  a  number  of  practical  problems  must  be  resolved.  These 
include  the  following  three:30 

1.  Ordinarily,  in  the  evaluation  of  proposals,  the  technical  pro¬ 
posal  and  the  cost  proposal  are  separated  so  that  consideration 
of  one  will  not  influence  consideration  of  the  other.  Obviously, 
if  a  contractor  is  to  design  to  a  cost  and  have  freedom  to  inter¬ 
change  cost  and  technical  perfornance,  both  aspects  of  his  pro¬ 
posal  must  be  considered  together.  Ttiis  requires  a  change  in  a 
practice  of  long  standing. 

2.  The  contractor  must  have  the  freedom  to  vary  the  internal  con¬ 
figuration  of  a  design  to  try  to  achieve  a  desired  cost.  If  the 
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Government  prescribes  the  design  in  minute  detail,  the  con¬ 
tractor  cannot  be  held  legally  responsible  for  the  cost  out¬ 
come.* 

3.  It  is  difficult  to  hold  a  developer  responsible  for  future  costs 
if  life-cycle  cost  is  the  basis  for  selection.  Analysis  of  the 
legal  problem  indicates  that  during  development  the  target  pro¬ 
duction  cost  has  no  contractual  relevance  other  than  as  a  design 
objective.  Otherwise,  it  would  represent  an  attempt  to  hold  con¬ 
stant  a  variable  that  is  dependent  upon  later  decisions  about  the 
values  of  certain  performance  levels.  Since  cost  as  well  as  per¬ 
formance  may  have  to  vary  during  development,  a  degree  of  uncer¬ 
tainty  is  imposed  that  cannot  be  removed  during  the  total  dura¬ 
tion  of  the  development  contracts  but  only  during  the  production 
contract.  An  attempt  to  invoke  a  promise  of  future  performance 
covering  the  target  cost  would  fail  under  Section  1-334  of  the 
ASPR,  which  prohibits  the  use  of  total  package  procurement  or 
production  options  for  systems  not  yet  developed. 

The  difficulty  of  establishing  enforceable  unit  production  or  flyaway 
cost  targets  during  the  development  phase,  as  well  as  the  potential  need 
to  allow  development  costs  to  rise  to  enable  design  for  lower  production 
costs,  argues  for  a  phasing  of  the  cost  targets  in  keeping  with  the  phas¬ 
ing  of  the  acquisition  itself.  At  least,  separate  development  and  pro¬ 
duction  (or  flyaway)  cost  targets  are  indicated,  with  production  cost 
fixed  (it  may  be  set  provisionally  earlier)  only  after  the  development 
part  of  the  cycle  yields  a  clear  idea  of  the  potentially  and  realistically 
achievable  production  cost.  Even  at  this  point,  early  production  experi¬ 
ence  may  show  that  further  changes  in  design  would  help  reduce  production 
costs  and  increase  reliability  further,  suggesting  a  resetting  of  the  pro¬ 
duction  or  flyaway  cost  target  after  low-rate  initial  production  (LRIP) 
for  systems  that  are  to  be  procured  in  quantity.  This  would  be  consistent 
with  the  notion,  discussed  at  other  points  in  this  report,  of  maintaining 
competition  through  production. 

‘"Military  Standards  could  have  this  effect  and  can,  therefore,  be  in  con¬ 
flict  with  DTC  acquisition  (Sections  IV-B,  D). 
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Assuming  DTC  acquisitions  can  be  achieved  successfully,  the  DOD 
would  also  face  certain  operational  difficulties.  Special  requirements 
for  military  use  may  mean  added  functions  or  environmental  constraints 
and  may,  therefore,  increase  the  cost  of  equipment  that  might  otherwise 
be  comparable  to  civilian  equipment.  Thus,  the  Government  may  not  always 
be  able  to  reduce  costs  by  acquiring  technology  from  the  civilian  economy. 
If  the  program  manager  and  the  contractor  can  make  changes  in  performance 
to  stay  within  the  target  cost,  the  user  faces  uncertainty  about  achieve¬ 
ment  of  the  performance  he  originally  deemed  necessary,  with  a  radiating 
impact  on  other  systems  and  the  operational  quality  of  his  force.  If  in¬ 
ternal  configuration  can  be  varied  to  hold  costs  down  and  to  rectify 
maintenance  and  reliability  problems,  successive  production  buys  of  a 
component  or  system  may  differ  sufficiently  to  complicate  logistics. 

Thus,  if  DTC  is  pursued  to  its  logical  limits  and  across  the  majority 
of  acquisitions,  structuring  of  overall  force  performance  capabilities 
around  what  can  be  achieved  for  a  given  amount  of  money  will  be  necessary 
to  a  much  greater  extent  than  was  true  in  the  past.  Especially  in  elec¬ 
tronics,  DTC  implies  that  there  would  have  to  be  more  reliance  on  proven 
technology  (including  advanced  proven  technology,  used  to  reduce  costs) 
and  avoidance  of  the  initial  costs  of  technological  advances  (i.e.,  oper¬ 
ating  points  low  on  the  cost-performance  curve  would  have  to  be  chosen). 

In  a  consequent  DOD  reliance  on  the  civilian  economy  for  technological 
advances,  those  advances  might  come  slower  than  the  DOD  desires  or  feels 
is  necessary.  Conversely,  the  cost  of  technologies  1  advance ,  if  the  DOD 
wishes  to  press  it,  must  necessarily  be  high  in  electronics,  since  DOD 
electronic  developments  and  procurements  represent  but  a  small  (and  de¬ 
clining)  fraction  of  the  total  market  (Section  II-J,  p.  64).  Thus,  DTC 
in  electronics  implies  greater  proliferation  of  military  equipment  designs 
using  commercially  standardized  parts  within  specially  designed  "black 
boxes,"  so  that  the  black  boxes  themselves  will  have  to  be  standardized  in 
form,  fit,  and  function  for  use  in  diverse  applications  or  for  incorpora¬ 
tion  in  successive  generations  of  major  systems  (p.  143).  The  resulting 
logistic  complexities  may  make  it  more  economical  for  the  DOD  either  to 
return  components  to  manufacturers  to  repair,  or  to  replace  rather  than 
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repair  electronic  devices  or  components  at  some  level  o.f  complexity.  The 
economic  tradeoffs  involved  remain  to  be  worked  out. 

From  all  the  above,  it  is  clear  that  the  D"C  concept  is  still  in  its 
infancy,  especially  for  DOD  electronic  equipment.  Much  remains  to  be 
learned  through  experience,  with  long-term  implications  for  the  military 
force  structure  and  the  DOD  ways  of  doing  business.  For  most  reasonably 
advanced  systems  (which  most  defense  systems  are;,  both  cost  and  perform¬ 
ance  are  likely  to  have  to  be  adjusted  during  the  DTbE  phases  of  DTC  pro¬ 
grams.  When  the  cost  goes  above  that  planned,  it  will  be  difficult  to 
demonstrate  that  this  higher  cost  is  still  below  the  cost  that  "would  have 
been  otherwise."  That  is,  it  will  be  difficult  to  measure  success.  How¬ 
ever,  success  in  the  production  phases  will  be  easier  to  measure,  since  by 
then  the  unit  production  or  flyaway  cost  will  probably  have  been  fixed. 
This  also  argues  in  favor  of  unit  production  or  flyaway  cost  as  the  prin¬ 
cipal  DTC  target. 

3.  Commercial  Comparability;  Competition 

As  a  number  of  recent  DOD  advisory  groups  have  pointed  out,"51  de¬ 
signing  to  a  predetermined  cost  has  been  a  way  of  life  in  the  commercial 
sector.  Although  it  is  difficult  to  generalize,  a  number  of  practices 
(performed  with  varying  degrees  of  success)  appear  to  be  inherent  in  the 
civilian  industrial  sector: 

-  Market  surveys  to  estimate  the  potential  sales  of  new  products  or 
improved  existing  products 

-  Setting  of  cost  targets  based  on  estimated  consumer  demand  and 
effects  of  competition 

-  Continuous  tradeoffs  of  performance  against  cost  to  ensure  a  match 
between  (a)  the  characteristics  and  price  of  the  product  and  (b) 
estimated  demand  and  demand  elasticity 

-  Periodic  involvement  of  top  management  in  general  decisionmaking 
while  maximum  freedom  is  granted  to  program  managers  in  daily 
operations 
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-  Close  coupling  of  engineering,  manufacturing,  and  financial  per¬ 
sonnel 

-  Consumer  testing  of  early  prototypes  of  a  product 

-  Continuous  feedback  of  field  data  to  design  engineers,  to  continue 
cost- performance  tradeoffs  and  competition  throughout  the  produc¬ 
tion  life  of  a  product 

-  Where  appropriate,  the  use  of  guarantees,  warranties,  or  factory- 
qualified  maintenance. 

While  many  of  these  practices  can  be  applied  to  DOD  acquisitions  of  compo¬ 
nents  and  systems,  important  differences  must  be  accounted  for.  Among 
these  differences  are  the  following: 

1.  Motivation.  Commercial  industry  is  oriented  toward  profitable 
sales.  Very  often  a  product  is  changed  to  improve  its  physical 
characteristics  (for  example,  its  weight  and  size)  and  other 
’'attractiveness”  features  while  its  performance  requirements  re¬ 
main  the  same.  This  is  true  for  products  that  have  been  on  the 
market  for  many  years,  such  as  radios,  and  for  products  recently 
introduced,  such  as  the  four -function,  hand-size  electronic  cal¬ 
culator.  A  wholly  new  product  must  show  promise  of  being  able  to 
stimulate  a  demand  sufficient  for  profitable  sales  at  a  price 
that  matches  both  its  producibility  and  some  estimate  of  its 
"value”  to  consumers.  The  DOD,  on  the  other  hand,  needs  to  match 
equipment  performance  to  a  perception  of  a  future  threat  or  mili¬ 
tary  need,  that  perception  being  based  on  estimates  of  the  capa¬ 
bilities  of  the  armed  forces  and  technologies  of  other  countries. 
Thus,  although  both  civilian  and  defense  planners  must  work 
against  certain  "market"  criteria  and  predictions,  it  can  be 
argued  tliat  the  defense  planner  has  less  control  over  the  deci¬ 
sion  as  to  what  and  whether  to  produce  in  the  area  of  new  "prod¬ 
ucts." 

2.  Economics  of  the  market  place.  In  industry,  the  break-even  point 
(in  time  and  numbers)  for  a  product  can  be  variable.  If  market 


173 


analysis  shows  that  a  product  must  sell  for  a  certain  price  and 
the  design  of  the  product  requires  costs  higher  than  those  ini¬ 
tially  planned,  industry  has  the  freedom  to  shift  its  break-even 
point  and  intensify  sales  effort  to  try  to  capture  a  larger  part 
of  the  market.  A  company's  development  and  pro. action  budget 
may  be  fixed  in  any  year,  but,  depending  on  the  financial  pros¬ 
pect  for  the  product,  plans  can  be  made  to  use  budgets  two  or 
three  years  ahead.  The  DOD,  on  the  other  hand,  usually  struc¬ 
tures  a  force  within  a  budget  that  is  allocated  to  it  annually  by 
external  organizations  in  the  executive  and  legislative  branches. 
The  DOD  must  pay  the  cost  of  the  numbers  of  items  it  needs  from 
the  budget.  The  flexibility  here  is  to  reduce  force  size  if 
costs  increase.  Force  reduction  is  often  rationalized  by  shoeing 
that  the  smaller,  higher-cost  force  will  have  an  overall  capa¬ 
bility  that  compensates  for  its  reduced  size.  This  sort  of 
rationalization  is  an  uncertain  substitute  for  the  relative  pre¬ 
cision  that  comes  from  successive  profit  measurements  of  a  com¬ 
pany’s  performance  in  the  civilian  sector. 

3.  Management  controls.  In  industry,  while  top-level  management 
can  intervene  to  change  the  direction  of  product  development  and 
production,  program  managers  and  intermediate  managers  are  judged 
mainly  by  sales  and  profits.  The  DOD,  on  the  other  hand,  is 
accountable  to  the  Congress  for  how  appropriations  are  spent. 

The  Congress,  no  less  than  DOD  management,  is  ^uncerned  about 
performance  requirements  for  major  systems,  and  it  must  decide 
whether  to  allocate  money  for  those  systems  based  on  its  judgment 
of  the  value  of  the  planned  performance  increment  relative  to  the 
threat  or  need,  as  that  threat  or  need  is  perceived  and  judged 
from  uncertain  forecasts  derived  by  severa?  gencies.  Obviously, 
political  connotations  are  also  of  importance  in  such  collective? 
decisions . 

Thus,  industry’s  accountability  is  based  on  output  perform¬ 
ance  measures,  while  the  DOD’s  is  based  on  ir,put--what  is  done 
with  the  money  given  it.  Output,  for  the  DOD,  can  be  measured 
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only  when  the  military  forces  are  used  in  conflict  or  deter¬ 
rence,  and  then  those  who  provided  the  forces  nay  no  longer  be 
responsible  for  their  performance. 

In  industry,  the  design  team  is  free  to  modify  configura¬ 
tions  to  meet  cost  targets.  There  are  relatively  few  specifica¬ 
tions  and  standards;  those  that  exist  are  ordinarily  promulgated 
by  professional  or  industrial  associations  and  accepted  volun¬ 
tarily.  To  support  its  accountability  for  the  expenditure  of 
public  funds,  the  DOD  has  promulgated  strict  and  detailed  speci¬ 
fications,  constraining  industry  in  designing  the  details  of 
systems  and  components.  The  DOD  also  desires  these  specifica¬ 
tions  to  simplify  logistic  support  and  to  ensure  that  equipment 
will  work  in  severe  environmental  conditions. 

Because  of  the  relative  nature  of  the  constraints,  commer¬ 
cial  practice  more  easily  permits  concentration  of  authority, 
with  freedom  for  program  managers  to  adapt  to  the  needs  of  the 
market  as  they  see  them.  In  the  DOD,  on  the  other  hand,  there  is 
great  diffusion  of  authority  because  of  the  diverse  review  chan¬ 
nels  and  levels  of  management  entailed  in  overseeing  the  expendi¬ 
ture  of  appropriated  funds. 


Another  important  area,  characteristic  of  the  commercial  world  and 
considered  important  for  DTC,  is  competition.  It  is  generally  accepted 

i 

that  during  the  design  and  development  phase  of  a  DTC  program  the  de¬ 
veloper  must  have  genuine  freedom  to  adjust  the  evolving  design  to  meet 
the  specified  target  cost,  or  to  adjust  the  two  together  to  achieve  de¬ 
sired  force  objectives.  The  military  project  manager  and  his  industrial 
contractor  must  work  together  in  this  iterative  process  by  reviewing  and 
modifying  cost,  schedule,  and  performance  requirements  vdien  they  are  found 
to  conflict  with  what  is  technologically  realizable  within  the  desired 
production  cost  limits.  Development,  production,  and  operating  costs  can 
be  balanced  in  the  same  way. 


1 


'5 


Ordinarily,  if  there  is  but  a  single  developer,  incentives  to  meet 
the  cost  target  may  be  lacking.  Moreover,  the  use  of  cost-reimbursement 
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contracts  for  the  development  phase,  generally  considered  desirable  for 
DTC  developments,  could  also  encourage  prolonged  and  unnecessary  develop¬ 
ment  effort  by  a  single  developer.  The  flexibility  permitted  the  de¬ 
veloper  implies  (as  has  been  noted  in  another  context)  uncertainty  about 
the  ultinate  design  outcome.  If,  at  the  completion  of  the  development 
program,  the  production  bid  is  above  the  previously  desired  target  cost  or 
if  the  design  ls  less  than  satisfactory,  and  if  there  have  been  no  competi¬ 
tive  developments,  the  military  manager  has  no  alternative  developer  to 
whom  to  turn  within  the  time  allotted  for  development  (that  is,  the  time 
at  whose  expiration  it  has  been  judged  the  new  component  or  system  is 
needed).  Thus,  in  general,  it  has  been  agreed  by  diverse  study  groups 
that  the  use  of  competing  developers  would  provide  greater  incentives  to 
each  to  complete  development  on  schedule,  meet  or  reduce  production  cost 
targets,  and  provide  the  best  possible  design  within  the  cost  constraints. 
Such  competition  would,  ideally,  enable  the  military  manager  to  compare 
designs  and  actual  production  price  bids  prior  to  selection.  This  study 
has  uncovered  a  number  of  such  instances.* 

The  way  competition  is  used  must,  however,  depend  on  the  kind  of 
system  and  its  cost.  Some  major  developments,  such  as  a  defense  naviga¬ 
tion  satellite  system,  a  major  advanced  aircraft  system,  or  a  major  ship, 
may  be  judged  to  be  too  large  for  the  Defense  Department  to  pay  for  even 
two  competing  prototypes.  Yet  it  is  in  exactly  such  huge  programs  that 
competition  may  prove  beneficial.  Experience  such  as  that  with  the  C-5A 
and  the  F-14  has  shown  that  vhen  the  cost  of  the  development  is  larger 
than  the  net  worth  of  the  developing  company,  and  in  the  absence  of  com¬ 
petition,  the  unhappy  option  most  often  open  to  the  Government  is  that  of 
either  continuing  acquisition  of  the  overly  expensive  system  after  it  is 
developed  (probably  in  reduced  numbers)  or  canceling  the  acquisition 
(possibly  bankrupting  the  contractor).  Then  the  issue  becomes  political, 
since  the  employment  of  thousands  of  people  and  the  health  of  a  section 
of  the  economy  are  at  stake. 


*E.g.,  AWACS,  AIM-9  series,  PAVE  SPIKE  pods. 
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Nevertheless,  even  when  the  Government  feels  that  it  cannot  support 
direct  competition,  other  choices  representing  indirect  competition  may  be 
available.  For  example,  a  military  adaptation  of  a  commercial  system 
(say,  in  computers)  may  be  available.  Moreover,  competitive  development 
and  procurement  could  still  be  applied  to  many  subsystems  and  components 
of  such  major  systems.  In  addition,  procurement  and  management  problems, 
and  the  implications  of  competition,  will  vary  according  to  whether  the 
Government  is  acquiring  high-technology  systems  that  are  few  in  number, 
such  as  communication  satellites  and  related  systems,  or  whether  it  is 
acquiring  a  large  number  of  relatively  inexpensive  systems  or  components, 
such  as  troop  radios. 

It  is  apparent  that  these  variations  will  interact  in  a  complex  way 

with  the  problems  of  using  competition  and  providing  options.  Success  of 

competition  in  the  civilian  economy  is  measured  by  sales  and  profits. 

Moreover,  one  of  the  welcome  outcomes  of  competition  in  the  civilian 

economy  is  a  diversity  of  products.  In  the  DOD,  the  impact  of  competition 

32 

is  more  difficult  to  measure  (Section  III-F).  While  the  data  show  ad¬ 
vantages  after  certain  points  in  the  acquisition  process  are  reached 
(e.g.,  kinds  of  systems,  size  of  development,  size  of  production  buy  vdien 
competition  is  introduced),  there  are  countervailing  costs.  Research  and 
development  may  cost  more;  unless  industry  is  motivated  to  increase  its 
share  of  these  costs ;  competition  through  production  may  incur  the  cost  of 
the  reprocurement  data  package;  gains  from  the  "progress"  or  "learning" 
curve  may  be  achieved  early,  with  less  subsequent  benefit  from  larger  pro¬ 
duction  runs;  and  the  DOD  as  a  whole  will  incur  the  possible  cost  of  a 
more  complex  force  if  the  diversity  of  designs  of  systems  or  components  to 
accomplish  a  specific  military  task  is  increased. 

4.  Current  Applications  of  Design- to-Cost  Programs 

In  July  1972,  DDR&E  requested  that  the  Services  select  appropriate 
electronic  subsystem  procurements  that  could  be  used  as  DTC  experiments. 
Accordingly,  ten  programs,  listed  in  Table  III-29,  were  nominated  by  the 
Services.  In  addition,  in  early  1973  a  number  of  major  systems  were  des¬ 
ignated  as  DTC  system  acquisitions  (Table  III- 30).  Subsequently,  a 
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memorandum  by  the  Deputy  Secretary  of  Defense33  initiated  the  process  of 
establishing  DTC  goals  for  all  major  DSARC  programs  that  had  not  yet 
reached  ’’milestone  III."  In  this  memorandum  the  cost  to  be  "designed 
to"  was  specified  as  the  average  unit  flyaway  cost.  The  memorandum 
authorized  the  Services  and  program  managers  to  make  adjustments  in 
performance  and  schedule  necessary  to  achieve  the  cost  goals.  It  also 
initiated  a  mechanism  for  reviewing  contractual  provisions  that  would 
have  to  be  changed  to  achieve  this.  All  future  programs  are  to  have, 
as  early  as  possible  and  not  later  than  the  beginning  of  full-scale 
development,  an  estimate  of  the  cost  to  be  designed  to. 

Although  the  major-system  DTC  efforts  will  be  observed  by  management 
in  its  efforts  to  hold  costs  down,  systematic  observation  of  major- system 
programs  for  analysis  of  problems,  successes,  and  failures  will  be  diffi¬ 
cult.  By  definition,  major  systems  are  large,  expensive,  and  important. 
As  a  consequence,  their  progress  is  a  sensitive  matter  and  they  are 
difficult  to  monitor  with  the  primary  objective  of  learning.  However, 
the  subsystem  experiments  do  not  present  these  problems  and,  therefore, 
represent  an  opportunity  to  experiment  with  DTC  acquisitions  in  the  elec¬ 
tronic  subsystem  area.  The  subsystem  DTC  experiments  have,  therefore, 
been  examined  in  some  detail  as  part  of  this  study. 

TABLE  III-29.  PROGRAMS  DESIGNATED  BY  THE  SERVICES 
FOR  DESIGN-TO-COST  EXPERIMENTATION 
IN  ELECTRONIC  EQUIPMENT  ACQUISITION 

Army 

Absolute  Altimeter  (AN/APN-209) 

Helicopter  LORAN  (AN/ARC- 114) 

Lightweight  Doppler  Navigation  System  (Helicopter) 

Low-Cost  FLIR 

Navy 

Low-Cost  Ship  EW  Suite 
Airborne  Radar  (WX  Series) 

Advanced  Airborne  Digital  Computer  (AADC) 

Air  Force 

Airborne  TACAN  (AN/ARN-XXX) 

Tactical  UIIF  Command  Radio  (AN/ARC-XXX) 

Medium-Accuracy  Inertial  Navigation  System  (MICRON) 


■% 
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TABLE  III- 30.  MAJOR-SYSTEM  DESIGN-TO-COST  PROGRAMS3 


Army 

1.  Man-Portable  Air  Defense  (MANPAD)  System 

2.  Armored  Reconnaissance  and  Scout  Vehicle 

3.  Utility  Tactical  Transport  Aircraft  System  (UTTAS) 

4.  New  Main  Battle  Tank  (MBT) 

5.  SAM-D 

6.  Advanced  Attack  Helicopter  (AAH) 


7.  AGILE  Missile 

8.  Patrol  Frigate 

9.  PHALANX  Missile 

10.  Patrol  Hydrofoil  Missile  Ship 

11.  AN/BQQ-5  Submarine  Sonar 

12.  AIM-7F  Missile 

13.  VSTOL  Technology  Prototype 

Air  Force 

14.  AX  (now  A- 10)  Close  Air  Support  Aircraft 

15 .  Lightweight  Fighter 

16.  Advanced  Medium  STOL  Transport 

17.  Low-Altitude  Supersonic  Target  Drone 


3Source:  Ref.  34. 


5.  The  Subsystem  Design-to-Cost  Experiments 

Table  III-31  shows  the  timetable  for  these  experiments.  Table  III- 32 
summarizes  the  salient  features  of  the  experiments  according  to  postulated 
desiderata  for  DTC  programs  emerging  from  the  above  considerations. 35 

From  Table  III- 32,  it  can  be  noted,  first,  that  three  of  the  ten 
designated  programs  are  not  currently,  or  are  not  yet,  formal  design- to- 
cost  programs,  as  discussed  in  the  relevant  DOD  sources.  Rather,  they  are 
programs  in  which  cost  is  receiving  more  emphasis  than  it  might  otherwise 
have  received.  One  of  these  projects  results  from  an  attempt  by  industry 
to  design  a  radar  to  a  specified  cost,  using  the  freedom  to  trade  perform¬ 
ance  for  cost  that  would  be  needed  in  DTC  programs ;  it  is  not  clear  yet 
whether  DOD  will  find  the  product  useful  and  acceptable.  When  it  is  more 
firmly  defined,  another  of  these  programs,  the  Army  FLIR  program,  would 
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provide  potential  candidates  for  DTC  contracts  on  the  very  large  procure 
ments  (several  hundred  million  to  a  billion  dollars)  that  will  be  in  the 
offing. 

TABLE  III- 31.  SCHEDULES  OF  SUBSYSTEM 
DESIGN-TO-COST  EXPERIMENTS 


Absolute  Altimeter 
(AN/APN-209) 

Helicopter  LORAN 
(AN/ARC- 114) 

Lightweight  Doppler  Naviga¬ 
tion  System  (Helicopter) 

Low-Cost  FLIR 


Navy 

Low-Cost  Ship  EW  Suite 


Airborne  Radar  (WX  Stries) 

Advanced  Airborne  Digital 
Computer  (AADC) 


Air  Force 

Airborne  TACAN 
(AN/ARN- XXX) 

Tactical  UHF  Command  Radio 
(AN/ARC- XXX) 

Medium-Accuracy  Inertial  Navi¬ 
gation  System  (MICRON) 


19-month  engineering  development, 
fall  1973  to  spring  1975. 

Engineering  development  and  test 
completion  mid-1975. 

Engineering  development  completion 
mid-1976. 

Testing  of  various  models  between 
mid- 1974  and  mid-1978. 


Schedules  are  part  of  competition; 
initial  design  phase  begun  January 
1973. 

Indefinite. 

Completion  of  most  hardware  early 
1976;  completion  of  various  segments 
of  software  1976-1977. 


14-month  engineering  development, 
beginning  mid-1973. 

9-month  development  RFP  issued  July 
1972;  development  not  completed. 

12  final  system  prototypes  plus 
testing  by  spring  1976. 
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Cost  an( 
Technolo< 
Evaluatic 
Linked  fc 
Contractt 


Service  and  Proaram 

Perfornance  Sought 

Target  Cost  and  Basis 

Selectior 

Army 

Absolute  Altimeter 
(AN/APN-209) 

Minimum  altitude  range,  accuracy; 
frequency;  size;  RAM.  Others 
"desired. " 

$3500  unit  production  cost  (max); 
2000  units;  90%  LC;  LCC  considered 
for  production. 

No 

Helicopter  LORAN 
(AN/ARC- 114) 

Minimum  performance  specified. 

$20,000  unit  production  cost  for 
2000  units;  87%  LC;  LCC  considered. 

No 

Lightweight  Doppler  Navi¬ 
gation  System  (Helicopter) 

Based  on  available  UK  and  Canadian 
prototypes. 

$20,000  unit  production  cost  for 

500  units. 

No 

Low-Cost  FLIR 

Modular  FLIR  developments  being  considered  for  missile  and  weapon  sights, 
Not  yet  formulated  as  DTC  program. 

combat  veh: 

Navy 

Low-Cost  Ship  EW  Suite 

Cost-phased  modular  suite;  con¬ 
tractor  to  specify  performance 
achievable  at  five  cost  levels. 

Navy  suggests  unit,  installation, 
and  RED  costs  based  on  Phase  I 
proposals. 

Yes 

Airborne  Radar  (WX  Series) 

Modular,  multipurpose  radar  family. 

A  contractor-developed  series  of  radars  designee 

Advanced  Airborne  Digital 
Computer  (AADC) 

General-purpose  modular  central 
computer,  1978-1990. 

None  specified  a  priori. 

No 

Air  Force 

Airborne  TACAN 

Minimum  performance  specifications, 

$10,000  unit  production  cost  for 

Yes, 

(AN/ARN-XXX) 

1000-hr  MTBF  required. 

500  units ;  life-cycle  cost  index 
for  production  competition. 

but  not 
at  first 

Tactical  UHF  Command 

Radio  (AN/ARC-XXX) 

Replaces  two  other  radios;  1000-hr 
MTBF. 

None  specified;  production  award 
to  lowest  LCC  bid. 

No 

Medium-Accuracy  Inertial 
Navigation  System 
(MICRON) 

Medium  accuracy;  light  weight; 
small;  2000-hr  MTBF;  nuclear 
hardness. 

$35,000  unit  production  cost  for 

500  units;  LCC  considered,  not 
specified. 

Sole-souro 

l?l  ft 


s 


F 


TABLE  III- 3 


Salient  Contract  Features 


Cost  and 
Technology 
Evaluation 
Linked  for 
Contractor 
Selection 

Freedom 
to  Trade  Off 
Cost/ 

Performance/ 

Schedule 

Other  Features 

i 

irget  Cost  and  Basis 

Government 
Options 
for  Buv 

Warranty 

Standardiza¬ 
tion  and 
Specifications 

Incentive! 

init  production  cost  (nax); 
nits;  90%  LC;  LCC  considered 
jduction. 

No 

Some  (excl. 
schedule ) 

5000-10,000 
units  ulti¬ 
mately 

Option 

Conventional 

CPAF 

3  unit  production  cost  for 
nits;  87%  LC;  LCC  considered. 

No 

Yes 

LRIP  plus 
production 

No 

Conventional 

CPIF  (deve! 
opment  onl; 

)  unit  production  cost  for 

Its. 

No 

Not  yet 
defined 

Not  yet 
defined 

Not  yet 
def ined 

Not  yet 
defined 

Not  yet 
defined 

for  missile  and  weapon  sights, 

combat  vehicle  driving  and 

fighting,  aircraft  flight  and  fire 

control,  and  ground  observat 

iggests  unit,  installation, 

>  costs  based  on  Phase  I 
ils. 

Yes 

Yes 

(priorities 

assigned) 

Flexible, 
for  many  or 
all  ships 

Option;  also  con¬ 
tractor  mainte¬ 
nance  option 

Conventional 

Left  to  coi 
tractor  pr< 
posal 

?actor-developed  series  of  radars  designed 

to  a  particular 

price  for  various  functions  and  performance.  Navy  is  consider 

tecified  a  priori. 

No 

No 

Not  yet 
decided 

No 

Conventional 

FP 

I  unit  production  cost  for 

Lts ;  life-cycle  cost  index 
xiuction  competition. 

Yes, 
but  not 
at  first 

Yes, 

Program 

Office 

0-9'00 

Option  for  2  yr, 
with  2  renewals 

Form- fit- 
function 

CPIF 

lecified:  production  award 
ist  LCC  bid. 

No 

No 

(reliability 

paramount) 

0-7000 

No, 

Air  Force 
maintenance 

Conventional 

FP/AF 

1  unit  production  cost  for 
.ts;  LCC  considered,  not 

■ed. 

Sole- source 

Yes 
(excl. 
schedule ) 

Estimated  5000-  Option 

10,000,  including 
all  sources  plus 
civil 

Not  set 

CPAF 

I  £  I  •  5 


TABLE  III- 32 


SUMMARY  OF  EXPERIMENTAL  DESIGN- TO- COST  DEVELOPMENTS  OF  SUBSYSTEMS 


r  Features 


Standardiza¬ 
tion  and 
pacifications 

Competition,  Actual  or  Planned 

Incentives 

Pre-  During 

Development  Development 

Pre- 

Production 

During 

Production 

Remarks 

Conventional 

CPAF 

Yes 

Yes 

Yes 

No 

Contractor  maintenance  option, 
post-warrarity . 

Conventional 

CPIF  (devel¬ 
opment  only) 

Yes 

Yes 

Yes 

No 

Originally  not  a  DTC  program. 

Not  yet 
defined 

Not  yet 
defined 

Yes 

Not  yet 
defined 

Not  yet 
defined 

Not  yet 
defined 

Engineering  development  RFP 
currently  being  formulated. 

>ntrol,  and  ground  observation  to  consolidate  many  developments  and  to  reduce  total  cost. 


Conventional 

Left  to  con¬ 
tractor  pro¬ 
posal 

Yes 

Yes 

Yes 

No 

Contractor  to  install  modules  on 
platforms  for  Navy  test  of  opera¬ 
tion,  operability,  documentation. 

formance.  Navy  is  considering  flight  test  and 

eva  luation 

program  to 

test  performance  and  RAM. 

Conventional 

FP 

Yes 

Yes 

Yes 

Not 

decided 

Not  formalized  as  a  DTC  program. 

Form- fit- 
function 

CPIF 

Yes 

Yes 

Yes 

ftaybe 

Arinc-type  specifications. 

Conventional 

FP/AF 

Yes 

Yes 

Yes 

No 

Model  for  test  required  with  pro¬ 
posal.  Arinc  advice  sought  on 
testing  and  selection. 

Not  set 

CPAF 

No 

No 

No 

No 

Based  on  company -funded  start. 
Other  contractors  to  help  monitor 
and  prepare  data  package. 

Of  the  remainder  of  these  programs,  all  but  one  involve  competition 
through  development,  but  few  or  none  will  carry  competition  into  procure¬ 
ment.  The  problem  of  judging  the  contractors'  proposals  on  the  interplay 
of  technical  performance  and  cost  is  apparently  not  yet  broadly  solved- - 
it  has  been  possible  to  have  a  single  evaluation  team  consider  the  cost 
and  technical  proposals  together  in  only  two  of  the  cases  listed.  Most  of 
these  programs  use  unit  production  cost  for  a  buy  of  a  particular  size  as 
the  target-cost  criterion,  but  the  planned  buys  in  all  cases  are  very  *much 
smaller  than  the  total  number  of  equipments  that  will  ultimately  be  needed 
and  thac  may  be  purchased.  Thus,  although  production  is  not  generally  in¬ 
tended  for  competition  in  these  programs,  a  contractor  might  still  find  it 
possible  to  make  a  very  low  bid  in  hopes  of  gains  from  later,  much  larger 
production.  On  the  other  hand,  a  number  of  the  programs  'e.g.,  UHF  radio 
and  others  with  incentive  contracts)  contain  specific  penalties  for  con¬ 
tractors  who  do  this. 

In  half  of  these  programs  life-cycle  costs  will  be  considered  in  the 
production  contract  award,  but  it  is  not  yet  clear  whether  the  basis  of 
calculation  of  life-cycle  cost  will  be  accurate  enough  for  fair  compara¬ 
tive  judgments.  Most  of  the  programs  provide  for  a  warranty  option,  and 
some  require  a  contractor  estimate  of  the  potential  cost  for  a  mainte¬ 
nance  contract.  Thus,  the  combination  of  life-cycle  cost,  warranty,  and 
maintenance  contract  estimates  may,  in  a  few  cases,  give  some  basis  for 
judging  the  contractors'  view,  prior  to  production  and  in  some  cases  early 
in  the  development  cycle,  of  the  impact  on  maintenance  and  reliability  of 
the  DTC  approach  in  these  programs.  However,  it  is  not  clear  that  any 
actual  warranty  or  contractor  maintenance  experience  will  be  gained,  since 
in  all  cases  there  are  only  options. 

All  the  programs  offer  at  least  some  flexibility  to  trade  off  some  or 
all  of  performance,  cost,  and  schedule.  Sometimes  the  program  manager  has 
this  flexibility,  sometimes  he  must  refer  to  a  higher  authority.  But  many 
of  the  performance  requirements  are  "hard,"  and  these  could  either  con¬ 
strain  the  tradeoffs  in  unanticipated  ways  or  be  found  to  drive  costs, 
posing  the  kinds  of  requirements/cost  exchange  problems  discussed  earlier. 
In  only  one  program  (the  Navy  electronic  warfare  suite)  can  it  be  said 
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that  the  potential  contractors  have  simply  been  told  what  the  job  is  in 
functional  terms,  given  a  statement  of  the  relative  importance  of  all  the 
performance  and  cost  factors,  and  left  to  see  what  they  can  accomplish 
competitively  in  making  all  of  the  tradeoffs  among  cost,  performance, 
schedule,  characteristics,  and  quantity.  In  this  program,  the  potential 
contractors  are  also  free  to  suggest  the  type  of  contract  they  believi; 
they  can  best  work  with.  In  only  one  program  (the  TACAN),  form- fit- func¬ 
tion  standards  are  specified  and  the  Arinc  approach  to  general  specifica¬ 
tions  is  taken.  Most  of  the  contracts  involve  some  form  of  award  or  in¬ 
centive  fee,  which,  in  some  of  these  contracts,  is  based  on  the  difference 
between  predicted  and  experienced  production  and  life-cycle  costs.  None, 
however,  appears  to  permit  the  contractor  to  save  money  in  development  and 
production,  using  the  difference  between  the  lower  cost  level  he  achieves 
and  the  agreed-upon  cost  level  as  an  incentive  to  cost  reduction. 

It  is  apparent  from  the  above  observations  that  these  ten  programs  do 
not  represent  a  controlled  "experiment"  in  which  all  or  most  of  the  impor¬ 
tant  variables  are  identified  and  varied  systematically  and  in  which  there 
are  enough  like  developments  to  test  the  statistical  significance  of  re¬ 
sults.  Practically,  such  an  experiment  would  be  difficult.  Even  in  these 
ten  programs,  however,  many  of  the  important  management  variables  will  be 
observed,  and  in  most  cases  for  more  than  one  acquisition.  These  include 
the  effects  of:  competition  (up  to  production);  ability  to  adjust  per¬ 
formance  somewhat  to  hold  to  set  costs;  ability  of  the  Government  to  pre¬ 
serve  its  options;  the  possible  use  of  warranties;  and  a  small  number  of 
variations  in  contract  incentives.  Thus,  something  will  be  learned  from 
these  programs.  It  may  even  be  possible  and  desirable,  in  programs  v^ere 
the  potential  outcome  seems  uncertain,  to  take  specific  courses  of  action 
explicitly  to  explore  the  potential  consequences. 

Nevertheless,  these  experimental  programs  are  so  few,  and  the  expe¬ 
rience  they  provide  is  likely  to  be  so  variable,  that  their  successes  or 
failures  will  be  difficult  to  generalize.  This  difficulty  can  be  alle¬ 
viated  by  adding  to  the  number  of  experimental  programs.  A  large  poten¬ 
tial  field  for  observation  is  available  from  the  numerous  Class  III 
systems  developments  (Section  III-B-4,  p.  155', . 
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Note  that  a  number  of  variables  are  not  or  may  not  be  observed  in 
the  present  ten  experimental  programs.  These  include:  competition  during 
production;  variation  of  standards  and  specifications;  freedom  to  vary  all 
five  components  of  a  requirement  (p.  128);  forms  of  contracts  other  than 
those  offering  incentive  or  award  fees;  and  a  wider,  more  representative 
sample  of  total  system  or  equipment  costs.  These  variables  could  be  made 
elements  of  some  of  the  additional  programs  selected  for  experiment. 

Overall,  around  30  programs  should  not  be  too  difficult  to  monitor 
and  should  give  more  varied  and  useful  data  for  later  application. 

It  must  be  noted  that  a  considerable  amount  of  time  will  elapse  be¬ 
fore  all  the  results  of  the  experimental  programs  are  available  (Table 
III- 31).  In  addition,  the  kind  of  systematic  observation  and  variation 
of  conditions  being  considered  here  does  not  yet  necessarily  apply  to 
major  systems  or  their  mission-critical  subsystems  (Classes  I  and  II). 

The  DOD  needs  early  DTC  information  for  management  and  needs  to  know  how 
to  extend  DTC  experience  with  development  of  independent  subsystems  to 
systems  of  Class  I  and  Class  II,  where  a  considerably  greater  amount  of 
money  may  be  at  stake.  Given  the  time  involved,  and  the  size  and  com¬ 
plexity  of  the  DOD  systems  acquisition  budget,  tr e  lessons  on  DTC  will 
doubtless  have  to  be  applied  as  they  are  learned,  before  all  the  results 
of  the  DTC  experiments  and  observations  have  been  obtained  and  analyzed. 

By  the  time  the  DTC  concept  and  the  knowledge  to  apply  it  have  reached 
maturity,  many  changes  in  philosophy  and  management  may  have  occurred  in 
the  defense  environment.  Yet,  as  our  discussion  of  the  operation  of  the 
requirements  process  shows  (Section  III-B),  the  problems  involved  in  DTC 
have  had  considerable  longevity. 

The  ten  subsystem  programs  discussed  as  DTC  experiments  above  are 
mainly  developments  that  would  have  gone  forward  in  any  event  but  were 
singled  out  for  specific  observation,  with  some  added  steps  in  the  di¬ 
rection  of  DTC.  This  approach  has  now  been  extended  to  major  systems 
as  well.  In  fact,  all  DSARC- level  systems  development  is  now  to  be 
managed  on  a  DTC  basis.  Certain  major  systems  (those  listed  in  Table 
III- 30)  were  the  first  major  systems  started  on  this  basis,  and  the 
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management  arrangements  and  many  of  the  decisions  affecting  them  have 
already  been  made.  They  would,  therefore,  be  useful  candidates  for  care¬ 
ful  observation  and  extraction  of  ’’lessons  learned’’  for  application, 
together  with  the  ’’lessons  learned”  from  the  ten  subsystem  DTC  experi¬ 
ments,  to  systems  just  entering  DTC  management. 

6.  Findings  and  Recommendations 

a.  Findings 

•  Design  to  cost  (DTC)  in  defense  systems  acquisition  is  still  in 
its  infancy.  Among  the  problems  yet  to  be  solved  are: 

-  How  to  establish  the  cost  target  in  view  of  the  lack  of  an 
adequate  data  base  and  limited  cost- estimating  techniques. 

-  How  to  resolve  the  uncertainty  for  the  user  resulting  from  con¬ 
tinual  cost-performance  tradeoffs  and  their  potential  effects  on 
force  size,  capability,  and  logistics. 

-  How  to  incorporate  commercial  cost-saving  practices  in  DOD  DTC 
procedures  when  motivations  and  accountability  are  basically 
different  in  the  two  sectors. 

-  And  how  to  extend  competition  through  the  acquisition  cycle, 
especially  for  acquisition  of  large-scale  systems  and  for  large- 
scale  procurements. 

•  Institutional  factors,  established  ways  of  doing  business,  and 
organizational  inertia  still  lead  to  DTC  procurement  practices  not 
consistent  with  the  DTC  philosophy,  such  as:  provisions  for  sepa¬ 
rate  evaluations  of  the  cost  and  the  technical  aspects  of  the 
proposals,  thus  precluding  the  requisite  tradeoffs;  requirements 
for  too  early  and  too  detailed  configuration  control  that  will 
interfere  with  evolutionary  improvements;  inflexible  application 
of  restrictive  specifications  on  materials,  parts,  processes,  and 
finishes;  and  various  other  restrictive  provisions. 

•  DTC  developments  may  be  more  expensive  than  traditional  develop¬ 
ments  in  which  production  cost  is  not  invoked  as  a  design  param¬ 
eter. 
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•  Wholehearted  implementation  of  DTC  in  military  electronics  im¬ 
plies  : 

-  Greater  reliance  on  proven  technology,  with  technological  ad¬ 
vance  driven  largely  by  the  commercial  sector  in  areas  of  broad 
commercial  usage. 

-  Changed  logistics  procedures,  including  more  detailed  analyses 
and  regular  consideration  of  the  alternatives  of  contractor 
maintenance  or  of  "zero  maintenance"  (i.e.,  throwaway  parts  or 
components). 

-  Use  of  interface  standardization  and  the  resultant  evolution  of 
several  competing  interchangeable  designs,  with  consequently 
increased  logistic  complexity.  Such  added  logistic  complexity 
can  be  more  tolerable  if  the  aforementioned  changes  in  mainte¬ 
nance  concepts  are  implemented. 

•  The  experimental  and  other  major-system  DTC  acquisitions  initiated 
in  1972  will  not  be  complete  in  time  to  provide  DOD  the  experience 
needed  for  other  acquisition  programs  in  the  near  future.  DOD 
will,  therefore,  probably  have  to  attempt  to  act  on  "lessons 
learned"  before  the  "experiment"  is  completed. 

•  The  ASPR  includes  no  barriers  to  DTC,  but  some  associated  contract 
implementation  practices  of  long  standing  must  be  changed  to  ob¬ 
tain  the  full  flexibility  that  DTC  requires. 

b.  Recommendations 

Choose  easily  defined  DTC  cost  targets  such  as  unit  production 
or  flyaway  costs  (rather  than,  for  example,  the  presently  stilJ 
ill-defined  life-cycle  costs;  but  see  next  paragraph).  Estab¬ 
lish  such  targets  early,  permitting  successive  revisions  durin ; 
development,  contractual  commitment  to  a  unit  cost  for  low- rat' 
initial  production  (LRIP)  at  the  str  ct  of  LRIP,  and  another  cor. 
tractual  commitment  for  unit  cost  at  the  start  of  full-scale 
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production  for  systems  to  be  procured  in  quantity.  Flexibility 
to  revise  cost  targets  should  decrease  and  should  be  based  in¬ 
creasingly  on  firm  experience  as  the  development- to- production 
cycle  progresses. 

If  the  equipment  is  to  be  maintained  by  the  supplier  under 
long-term  warranty,  the  DTC  target  can  be  established  as  the 
sum  of  the  production  cost  and  total  warranty  cost;  this  sum 
may  be  considered  a  surrogate  for  life-cycle  cost.  But  if  mili¬ 
tary  maintenance  is  contemplated,  establishing  life-cycle  cost 
as  a  DTC  target  is  not  now  appropriate  because  of  the  inadequacy 
of  current  knowledge  of  the  cost  to  the  Government  of  military 
maintenance,  and  of  the  dependence  of  these  costs  on  equipment 
parameters. 

Establish  explicit  limits  of  deviation  from  "desired’'  perform¬ 
ance/characteristics/cost/ schedule/quantity  requirements,  and 
authorize  program  managers  to  trade  off  freely  among  these  sepa¬ 
rate  requirement  parameters  within  the  established  limits. 
Establish  "desired"  parameters  and  permissible  deviations  such 
that  tradeoffs  are  in  fact  possible  and  not  subject  to  hidden 
constraints  due  to  technical  feasibility,  absolute  force  re¬ 
quirements,  or  available  budgets. 

To  the  extent  feasible,  maintain  design  and  price  competition 
throughout  the  acquisition  process,  especially  for  components 
and  subsystems. 

In  the  contractor  selection  process,  ensure  that  performance 
and  cost  are  considered  together  rather  than  evaluated  sepa¬ 
rately. 

★★  This  study  identified  only  one  DTC  acquisition,  namely,  the  Navy 
electronic  warfare  suite,  that  uses  the  approach  of  specifying 
equipment  needs  and  requirements  functionally,  leaving  it  to  the 
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competing  contractors  to  propose  optimal  development  and  pro¬ 
duction  strategies  to  maximize  payoff  to  both  the  Government 
and  the  contractors,  and  including  maintenance  strategies  among 
the  variables.  More  experimentation  with  this  approach  should 
be  undertaken. 

★  Increase  the  number  of  DTC  acquisitions  of  electronic  subsystems 
designated  as  "experimental"  for  observation  and  extraction  of 
"lessons  learned."  Include  in  these  observations  the  electronic 
subsystems  of  the  17  major  systems  designated  as  "design  to 
cost"  in  early  1973  (Table  III-30,  p.  179).  In  further  experi¬ 
mental  DTC  acquisitions,  seek  wider  variation  of  the  management 
variables  relevant  to  DTC  (for  example,  tradeoffs  among  require¬ 
ments,  program  manager's  freedom  to  trade  off,  competition 
throughout  the  acquisition  cycle,  and  different  types  of  con¬ 
tract).  The  Services  should  publish  "lessons  learned"  periodi¬ 
cally  to  maximize  the  pool  of  explicitly  analyzed  experience 
available  to  all. 
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★*  Review  the  contracting  procedures  associated  with  DTC  contracts, 
modify  those  that  inhibit  requisite  DTC  flexibility,  and  incor¬ 
porate  the  modifications  in  the  ASPR,  if  necessary. 
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D.  DESIGN  FOR  IMPROVED  RELIABILITY 


The  move  simple  an'j  thing  is,  the  less  liable  it 
is  to  be  disordered,  and  the  easier  repaired  when 
disordered. 

--Thomas  Paine 


1.  General  Methodology 

In  the  design  of  an  equipment  for  improved  reliability,  the  first 
step  is  to  provide  a  requirement  for  reliability,  availability ,  and  main¬ 
tainability  (RAM)  consistent  with  mission  needs  and  to  translate  this  into 
a  detailed  RAM  specification  that  will  meet  the  needs  of  the  mission  while 
minimizing  the  cost  involved.  The  cost  in  this  cortext  is  the  life-cycle 
cost,  embracing  both  acquisition  and  O&M  costs.  Many  aspects  of  the  de¬ 
sign  of  systems  for  high  reliability  are  well  known.  They  include,  for 
example:  use  of  high-quality  components;  great  care  in  ensuring  repeat- 
able  processes  and  high-quality  workmanship  in  the  assembly  of  those  com¬ 
ponents;  system  design  techniques  that  derate  the  components  so  that  they 
operate  under  conditions  less  severe  than  the  ones  for  which  they  were 
designed;  limited  use  of  redundancy  for  parts  of  a  system  that  are  partic¬ 
ularly  prone  to  failure  and  that  are  essential  to  the  function  of  the 
system;  use  of  burn-in  after  assembly  of  a  given  part  of  a  system  to  make 
sure  that  infant  mortality  among  components  and  poor-quality  workmanship 
are  exposed  during  the  burn-in  periods  and  are  then  corrected.  During  a 
carefully  documented  development  program  on  the  AN/APQ-113  radar,  General 
Electric^7  has  found  that  failures  were  about  one-third  due  to  components, 
one-third  due  to  workmanship  (otherwise  known  as  quality),  and  one-third 
due  to  design.  This  is  fairly  typical  for  a  new  design.  In  older  de¬ 
signs,  failures  are  usually  due  mostly  to  components  and  quality,  failures 
due  to  design  having  been  already  weeded  out. 

One  other  major  consideration  in  designing  for  improved  reliability 
is  design  simplicity.  There  exists  a  well-known  relation  between  equip¬ 
ment  complexity  and  MTBF:  the  greater  the  complexity  (measured  either  in 
38  39 

parts  count  or  in  unit  production  cost  ),  the  lower  the  MTBF.  It  is 
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important  to  limit  design  complexity  so  that  the  required  MTBF  can  be 
attained  in  practice.  The  two  references  cited  suggest  guidelines  for 
this . 
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In  addition  to  design  features  intended  to  minimize  failures,  it  is 

essential  to  give  careful  consideration  in  the  design  process  to  system 

partitioning  and  to  the  levels  of  the  maintenance  organization  at  vdiich 

certain  repairs  are  to  be  carried  out.  A  brief  study  of  an  analytical 

40 

model  of  an  idealized  system  suggests  that  repair  costs  are  least  when 

a  system  is  partitioned  into  modules  of  approximately  equal  cost.  The 

levels  of  repair  can  be  determined  by  an  analytical  procedure,  using  such 

techniques  as  the  Army’s  Generalized  Electronics  Maintenance  Model  (GEMM) 

41 

to  compare  the  cost-effectiveness  of  various  maintenance  policies.  It 
often  turns  out  that,  over  a  broad  range  of  the  significant  parameters, 
one  maintenance  policy  is  distinctly  preferable  to  the  others  if,  for  ex¬ 
ample,  the  ratio  of  operational  availability  to  lifetime  maintenance  cost 

41 

is  used  as  the  figure  of  merit  to  be  maximized.  The  validity  of  such 
an  analysis  is  predicated,  of  course,  on  the  validity  of  the  historical 
data  used. 

2 .  Methodology  for  Reliability  Growth 

When  all  is  said  and  done,  the  usual  experience  is  that  when  a  new 
design  is  first  assembled,  its  reliability  is  approximately  one-tenth  of 
what  was  predicted  on  the  basis  of  component-failure-rate  data.37  The 
problem  then  is  to  structure  a  "test-and-f ix"  program  which  will  result 
in  growth  of  reliability  with  time.  Much  of  that  growth  can  occur  in  the 
plant  before  demonstration  tests  to  eliminate  component,  design,  and 
quality  defects.  To  ensure  that  field-induced  failure  causes  are  elim¬ 
inated,  further  reliability  growth  must  take  place  in  the  field  after  the 
equipment  has  been  accepted.  It  is  absolutely  essential  to  have  a  formal 
management  technique  that  can  be  used  to  ensure  that  reliability  does  in¬ 
deed  grow  to  the  specification  value  before  demonstration  tests.  This 
can  be  done  by  testing  and  fixing,  testing  and  fixing,  testing  and  fixing. 
By  "fixing”  we  mean  finding  the  origin  of  each  failure  and  permanently 
eliminating  it.  For  example,  if  a  circuit  design  is  faulty,  it  must  be 
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corrected  so  as  to  eliminate  the  failures  that  result  from  it,  and  if  a 
joint  is  cold- soldered,  the  soldering  process  must  be  improved.  It  has 
been  found  that  when  this  test-and-fix  approach  is  used  and  is  rigidly 
adhered  to,  reliability  does  indeed  grow.  In  fact,  if  the  failure  rate 
or  the  MTBF  is  plotted  on  log- log  paper  versus  the  cumulative  test-and-fix 
time,  the  plot  looks  like  a  straight  line.  The  log  (MTBF)  increases  lin¬ 
early  with  the  log  (cumulative  test-and-fix  time)  at  such  a  rate  that  its 
slope  is  somewhere  between  0  and  0.86--usually  about  0.5  or  0.6  for  a 
program  that  has  sufficient  management  attention  to  ensure  that  all  the 
necessary  fixes  are  indeed  done  and  that  testing  is  not  interrupted  too 

early.  This  kind  of  graph  is  known  as  a  Duane  curve.  It  was  first  used 
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by  Duane  of  General  Electric  in  increasing  the  reliability  of  a  variety 

43 

of  diverse  equipments,  the  curves  for  which  are  given  in  Fig.  Ill- 15. 

The  Duane  curve  was  later  used  during  development  of  the  AN/APQ-113 
radar.37  It  provides  a  very  convenient  management  tool  for  planning  the 
reliability  growth  of  a  new  system,  since  it  permits  prediction  of  the 
growth  of  system  reliability  as  a  function  of  the  cumulative  text-and-fix 
time  of  the  system.  It  also  allows  prediction  of  the  cost  of  the  relia¬ 
bility  increase  if  the  cost  of  the  test-and-fix  time  is  known.  For  this, 
one  has  to  know  the  cost  of  testing  and  the  average  cost  of  the  fixes 
usually  require J  (Fig.  Ill- 16). 

The  Duane  curve  is  also  an  attractive  tool  for  use  in  monitoring  and 
predicting  the  field  reliability  of  systems,  although  thus  far  it  has  not 
been  so  used.  The  test-and-fix  process  can  be  continued  after  system  de¬ 
ployment  to  promote  the  growth  of  field  reliability,  but  the  cost  of 
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doing  so  is,  of  course,  substantially  greater,  often  by  a  factor  of  10, 
than  the  cost  of  achieving  the  required  reliability  before  equipment  de¬ 
livery.  The  cost  includes  the  cost  of  additional  spares  that  must  be 
present  in  the  supply  pipeline  during  a  test-and-fix  period,  the  costs  of 
equipment  modification  and  retrofit,  and  the  less  tangible  down-time  costs 
for  the  weapon  system  in  which  the  electronics  is  installed. 

We  must  note  here  the  considerable  similarity  between  the  NASA  phi¬ 
losophy  of  reliability  that  requires  the  complete  lot-traceability  of 
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FIGURE  111-15.  Original  Duane  Dntj 
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STEPS  IN  THE 

RFM  PROCESS:  •  PREDICTION:  SIMPLIFY  DESIGN  UNTIL  MIL-HDBK-217  PREDICTION 
MEETS  REQUIREMENT  WITH  25%  MARGIN 

•  OFF  THE  BOARD  DESIGN:  PERFORMS  AT  10%  OF 
PREDICTED  CAPABILITY 

•  SCREENING  PROCESSING:  ADJUST  TO  USE  ENVIRONMENT 

•  GROWTH:  PLAN  PROGRAM  BASED  ON  RELIABILITY  GROWTH 
AND  RTM  TRADEOFFS 
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FIGURE  111-16.  Reliability  Planning  and  Management  (RPM) 
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every  part,  on  the  one  hand,  and  the  Duane  test-and-fix  method,  on  the 
other.  The  Duane  test-and-fix  method  also  requires  that  the  source  of 
every  identifiable  failure  be  determined  and  permanently  eliminated. 

Making  sure  that  any  particular  failure  does  not  recur  may  entail  a  very 
substantial  degree  of  traceability. 

3.  Motivation  for  Reliability  Growth 

While  the  Duane  curves  provide  a  methodology  for  management  to  ensure 
the  growth  of  reliability,  they  do  not  necessarily  provide  the  motivation 
for  management  to  do  this.  One  possible  way  of  providing  this  motivation 
is  to  internalize  life-cycle  costs  to  the  contractor,  that  is,  to  make 
sure  that  the  contractor's  overall  profit  or  loss  depends  on  the  total 
life-cycle  cost  of  the  system.  Later,  in  Section  IV-A,  or  warranties,  it 
will  be  seen  why  we  believe  this  can  be  done  by  means  of  contractor  main¬ 
tenance  warranty  (CMW),  that  is,  long-term  warranty  in  which  the  con¬ 
tractor  undertakes  for  a  fixed  price  to  maintain  the  system  for  a  speci¬ 
fied  number  of  years  after  it  is  fielded. 

4.  Findings  and  Recommendations 

a.  Findings 

•  The  essence  of  reliability  is  simplicity.  Empirical  evidence 
indicates  clearly  that  most  equipments  of  high  unit  production 
cost  or  high  complexity  have  lower  MTBF  than  equipments  of  lower 
unit  production  cost  or  lower  complexity.39’^1 

•  The  reliability  of  electronic  components  is  improving  rapidly, 
and  design  revisions  to  incorporate  modern  technology  at  the 
appropriate  stage  of  maturity  can  substantially  improve  elec¬ 
tronic  equipment  reliability  without  detriment  to  performance. 

However,  premature  or  inappropriate  application  of  new  technology 

.  45 

leads  to  reduced  utility. 

•  Few  military  development  programs  are  aimed  at  increasing  relia¬ 
bility  through  simplification  or  technological  upgrading  while 

45 

holding  performance  constant. 
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•  Attainable  reliability  can  be  crudely  predicted  on  the  basis 
of  equipment  complexity  or  unit  production  cost.  Reliability 
requirements  in  specifications,  however,  are  not  based  on  such 
predictions  and  thus  are  frequently  impossibly  high  or  needlessly 
low.39’41’45 


•  System  partitioning  into  LRUs  or  WRAs  can  be  devised  in  a  way 
that  minimizes  support  costs,  if  this  aspect  of  system  design  is 
considered  simultaneously  with  planned  provisioning  and  mainte- 

-•  40 

nance  practices. 

•  The  growth  of  measured  reliability  is  often  sluggish  in  the 
factory.  After  the  equipment  is  received  by  the  Services,  the 
field  reliability  often  never  achieves  growth;  rather,  it  de¬ 
clines.  Formal  reliability  monitoring  and  management  can  speed 
reliability  growth  both  in  the  factory  and  in  the  field  and  make 
the  ultimate  cost  and  outcome  predictable. 

•  Motivating  a  contractor  to  design  for  minimum  life-cycle  cost  is 
an  important  potential  stimulant  to  reliability  improvement.  One 
approach  is  to  make  the  contractor  responsible  for  maintenance  as 
well  as  production  costs  through  the  application  of  long-term 
warranties.46 

b.  Recommendations 

■kick  Limit  the  complexity  of  new  subsystem  or  equipment  designs  (as 
measured  by  criteria  such  as  unit  production  cost  or  parts 
count)  to  a  level  consistent  with  the  reliability  required  by 
a  mission  analysis.  Require  evidence  of  compliance  as  a  pre¬ 
liminary  to  DSARC  review  for  electronic  subsystems  of  major 
systems,  and  as  a  preliminary  to  sub-DSARC  review  for  independ¬ 
ently  developed  electronic  subsystems. 

kkk  Require  contractually  the  in-plant  use  of  a  formal  manage¬ 
ment  methodology,  such  as  methods  using  Duane-curve  monitor¬ 
ing,  to  ensure  reliability  growth  in  electronic  equipments 


kkk  Highest  priority;  high  priority;  ★  priority. 
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and  systems.  For  field- reliability  enhancement,  a  formal 
reliability-growth  management  technique  should  be  applied 
(by  Service  management  action  or  contractual  requirement) 
to  selected  equipments  on  an  experimental  basis. 

Use  long-term  contractor  maintenance  warranties  to  motivate  the 
contractor  to  design  for  minimum  life-cycle  ccst.  [See  the 
later  recommendations  on  warranties  (Section  IV-A-7)  for  fur¬ 
ther  details.] 

Specify  the  reliability  of  electronic  equipments  or  systems  to 
be  consistent  with  predictions  based  on  their  anticipated  com¬ 
plexity  (or  unit  production  cost,  as  a  surrogate  for  complex¬ 
ity). 

***  Undertake  redesign  of  selected  equipments  with  the  specific 
objective  of  improving  reliability  while  holding  performance 
constant.  The  selection  of  equipments  to  be  redesigned  should 
be  based  on  expected  future  utility  and  an  observed  reliability 
substantially  lower  than  that  predictably  realizable  by  using 
up-to-date,  proven  technology. 

-  Make  sure  that  the  original  design  of  a  system  takes  account  of 
the  need  for  partitioning  it  into  WRAs  or  LRUs  in  such  a  way  as 
to  optimize  reliability,  facilitate  maintenance,  and  minimize 
ouppnrt  costs  under  a  broad  range  of  likely  conditions  of  de¬ 
ployment.  Thi«s  will  require  broader  application  and  some  fur¬ 
ther  development  of  existing  mathematical  models,  as  well  as 
persistent  emphasis  on  the  use  of  valid  input  data. 


***  Highest  priority;  *★  high  priority;  ★  priority. 
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Competition  occurs  before  program  commitment  and  during 
formulation  of  requirements.  There  is  less  competition 
after  program  award  because  there  is  usually  a  single 
contractor  and  a  single  customer,  and  the  competition 
from  other  programs  is  only  indirect. . . .  The  use  of 
competition  can,  in  many  instances,  be  a  more  effective 
incentive  than  profit  alone....  Commercial  practice  dem¬ 
onstrates  that  a  beneficial  impact  on  design-to-cost  is 
made  if  competition  is  extended  over  the  program's  life. 

...(We  recommend)  that  effective  hardware  competition  be 
maintained  over  an  extended  period  of  program  develop¬ 
ment  and  production,  as  long  as  possible,  and  to  the  ex¬ 
tent  applicable  to  systems,  subsystems,  and  components. 

We  believe  that  these  observations  and  the  recommendation,  which  refer  to 
military  weapons  systems,  apply  equally  well  to  military  electronics. 
However,  electronics'  place  as  a  subsystem  of  weapons  systems  requires 
special  procedures  in  order  to  make  extended  competition  possible. 


Despite  its  use  in  many  development  programs  and  some  production 
programs,  competition  is  a  missing  ingredient  in  about  two-thirds  of  mili¬ 
tary  prime  contract  awards,  and  the  larger  the  contract,  the  less  the 
likelihood  of  competition  (Table  III-33).  Over  three-fourths  of  the 
number  and  of  the  dollar  volume  of  contracts  over  $10  million  were  non¬ 
competitive  in  FY  1972.  That  this  situation  extends  into  the  electronics 
area  is  indicated  by  the  fact  that,  in  FY  1972,  58.5  percent  of  the  pro¬ 
curement  data  clearances  at  the  Army  Electronics  Command  were  for  noncom¬ 
petitive  procurements  (Table  III- 34). 

The  concept  of  competitive  development,  prototyping,  and  "fly-off" 
has  been  pretty  well  accepted  both  by  industry  and  Government,  and  need 
not  be  harped  on  here.  But  in  a  large  part  of  military  electronics  pro¬ 
curement,  competition  ceases  when  the  production  contractor  is  selected.* 

*0r  when  the  development  contractor  is  selected,  if  development  is  by  a 
single  contractor  with  a  high  probability  of  a  large  production  follow 
on. 
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TABLE  III- 33.  MILITARY  PRIME  CONTRACT  AWARDS, 
FY  1972  AND  FY  1971* 


Award  Size, 
millions 

Dollar  Amount 
in  Category, 
billions 

Percentage  of 
Award  Dollars 
in  Cateaorv 

Pr ice- C  ompe  tit ive 
Dollar  Volume 
in  Category 

Noncompetitive 
Dollar  Volume 
in  Category 

FY  1972 

$10  or  more 

$12,644 

39.2% 

23.2% 

76.8% 

$5  to  $10 

2.765 

8.6 

31.8 

68.1 

$2  to  $5 

4.205 

13.0 

37.6 

62.3 

$1  to  $2 

2.429 

7 .  S 

39.4 

60 . 6 

$0.5  to  $1 

2.381 

7.4 

40.4 

69.6 

$0.3  to  $0.5 

1.468 

4.5 

40.1 

59.9 

$0.2  to  $0.3 

0.976 

3.0 

40.7 

59.3 

$0.1  to  $0.2 

1.401 

4.3 

42.1 

57.9 

$0.1  or  more 

i 

$28,269 

•>7.5% 

31.5% 

68 . 5% 

FY  1971 

1 

$0.1  or  more 

a Source:  Ref.  47. 

$26,022 

8  7.6% 

33.4% 

66 . 6% 

TABLE  III- 34.  ARMY  ELECTRONICS  COMMAND 


PROCUREMENT  DATA 

CLEARANCES 

FY  1972 

Competitive 

Noncompetitive 

Number  of  Procurement  Clearances 
(excluding  MIFRs) 

148 

209 

Fraction  of  Clearances  (exclud¬ 
ing  MIPRs) 

41.5% 

58.5% 

FY  1971 

Number  of  Procurement  Clearances 
(excluding  MIPRs) 

148 

236 

Fraction  of  Procurement  Clear¬ 
ances  (excluding  MIPRs) 

38.5% 

61.4% 
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The  pressures  of  a  "one-shot”  competition,  exacerbated  in  a  monopsonistic 

economy  (one  buyer,  many  sellers),  frequently  leads  to  contracts  that  are 

48 

unrealistically  low  in  price.  Because  of  the  tendency  of  the  Govern¬ 
ment  to  aggregate  procurements  into  large-scale,  multiyear  buys,  to  take 
advantage  of  learning  curves,  the  potential  losses  to  the  single  winning 
bidder  by  virtue  of  misestimating  or  overdiscounting  future  risks  can  be 
enormous.  If  cost  pressures  force  the  only  production  contractor  to  re¬ 
sort  to  "changes"  or  other  claims  against  the  Government  to  ensure  that 
he  will  rot  lose  money,  the  Government  has  little  choice  but  to  accede  be¬ 
cause  of  schedule  pressures  and  possibly  because  a  planned  installation 
has  been  tailored  to  the  specific  equipment  design.  If  the  contractor's 
deliveries  are  late,  if  the  equipment  reliability  is  less  than  desirable, 
or  if  the  performance  is  poor,  the  Government  has  no  immediate  alterna¬ 
tive.  Because  the  lack  of  competition  after  award  to  a  single  contractor 
requires  rigid  contractual  and  configuration  constraints,  equipment  de¬ 
signs  are  essentially  frozen,  sometimes  for  a  decade,  despite  technolog¬ 
ical  development  and  potential  design  changes  that,  if  incorporated, 
could  reduce  cost,  improve  performance,  and  increase  reliability. 

It  may  seem  paradoxical  to  assert  that  enhancing  competition  can  re¬ 
solve  problems,  some  of  which  have  been  created  by  competition,  but  we 
believe  it  can.  Specifically,  it  appears  that,  by  properly  laying  the 
groundwork,  it  may  be  possible  to  mitigate  the  problems  of  a  "one-shot" 
competition  and  monopsony  in  military  electronics  procurement  and  to  emu¬ 
late  to  a  degree  the  many-buyer,  many-seller  civilian  economy.  To  create 
the  effect  of  many  buyers  and  many  sellers,  there  are  two  useful  steps: 

1.  Fragment  into  several  sequential  design-  and  price-competitive 
procurements  buys  that  under  current  practices  would  have  been 
aggregated  and  awarded  to  a  single  contractor. 

2.  Ensure  that  equipments  of  similar  performance  characteristics 
are  interchangeable,  to  make  it  possible  not  only  for  the  Ser¬ 
vices  to  accept  equipments  of  competing  designs  from  several 
suppliers,  but  also  for  an  equipment  supplier  to  sell  the  same 
item  to  more  than  one  Service. 


In  Section  III-F,  on  production,  it  will  be  shown  that  often  the  re¬ 
ductions  in  price  obtainable  through  sequential  competition  exceed  those 
obtainable  through  aggregated  buys  from  a  single  supplier.  The  examples 
shown  there,  however,  are  of  pure  price  competition  and  do  not  involve 
design  competition.  When  competition  in  both  design  and  price  is  intro¬ 
duced  in  several  successive  procurements  of  a  single  item,  it  is  antici¬ 
pated  that  suppliers  will  be  motivated  to  improve  and  simplify  internal 
designs,  with  a  resultant  increase  in  reliability  as  well  as  a  reduction 
in  cost.  To  encourage  such  improvements,  configuration  control  proce¬ 
dures  must  admit  speedy  approval  of  internal  changes  that  do  not  affect 
interchangeability . 

To  foster  continuing  design  competition  through  several  successive 
procurements,  the  Government  could  find  it  necessary  to  increase  its 
initial  development  investment  by  supporting  more  than  one  competitive 
development.  However,  the  need  for  added  Government  support  of  develop¬ 
ment  may  well  be  mitigated  by  undertaking  to  test,  qualify,  and  admit 
to  competition  designs  developed  on  their  own  investment  by  suppliers 
who  are  motivated  by  the  opportunity  to  compete  several  times  for  por¬ 
tions  of  the  production  requirements.  Moreover,  the  growing  adoption 
of  a  policy  of  continuing  the  development  competition  to  the  point 
of  "fly- off”  and  ” shoot-off”  means  that  most  of  the  increment  of  de¬ 
velopment  investment  needed  to  establish  production  competition  will 
have  already  been  made. 

Continuing  design  and  price  competition  is  obviously  best  suited  to 
moderate- to- large- size  programs  contemplating  deliveries  spread  over  a 
period  during  which  technological  growth  is  likely.  The  support  of  a 
variety  of  deployed  designs  can  be  facilitated  by  field  replacement  of 
failed  units  and  their  repair  at  depots  or  contractor  facilities. 

There  is  a  second  kind  of  competition  toward  which  design  efforts 
can  be  usefully  directed:  that  between  old  and  new  technology.  Tanks, 
planes,  ships,  and  missiles  are  long-lived  platforms  in  which  are  in¬ 
stalled  electronic  subsystems  that  rapidly  obsolesce  because  of  external 
technological  advances. 
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As  these  installed  systems  age  technologically,  they  may  be  excelled 
in  performance  and  reliability  by  equipments  of  more  modern  design.  Were 
the  modern  designs  fully  interchangeable  with  the  older  ones  without  plat 
form  modification,  the  weapon-system  manager  could  be  presented  with  a 
significant  competitive  alternative  in  the  upgrading  of  his  system.  With 
out  such  interchangeability,  the  manager  cannot  arrange  to  modernize  with 
out  scheduling  a  costly  and  perhaps  militarily  risky  stand-down  of  the 
weapon  system  to  undergo  installation  modification. 

Again,  what  is  required  is  the  imposition  of  interface  standards  to 
ensure  that  new  equipment  is  conveniently  interchangeable  with  equipment 
that  it  may  replace,  without  requiring  platform  modification. 

1.  Findings 

•  Competition  is  a  missing  ingredient  in  about  two-thirds  of  mili¬ 
tary  prime  contract  awards.  Even  when  a  program  does  admit 
development  competition,  there  is  a  strong  tendency  for  the 
Government  to  become  locked  into  a  single  supplier  in  subsequent 
production.  The  loss  of  Government  freedom  of  action  permits 
suppliers  to  force  prices  up  by  various  devices.  The  use  of 
large-scale,  multiyear  buys  exacerbates  the  risks  to  both  the 
Government  and  its  suppliers,  as  well  as  inducing  design  stagna¬ 
tion  in  the  equipment  procured. 

•  Competition  among  similar  equipments  designed  by  different  sup¬ 
pliers  and  the  upgrading  of  the  electronics  complement  of  weapons 
systems  are  both  now  severely  inhibited  by  the  lack  of  inter¬ 
changeability  among  like  equipments  and  the  consequent  high  cost 

and  enormous  inconvenience  of  modifying  installations  to  accom- 
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modate  substitutions. 

•  In  commercial  airline  electronics  and  elsewhere  in  the  civilian 
economy,  interface  standardization  and  continuing  design  and 
price  competition  are  used  to  hold  prices  down,  maintain  alterna¬ 
tive  sources  of  supply,  encourage  design  improvement,  and  allow 
for  interchangeability  among  successive  generations  of  electronic 


subsystems.  Periodic  buys  spaced  over  the  procurement  period 

minimize  the  impact  of  buyer  or  supplier  error  in  any  one  con- 

.  .  50 

tract. 

2.  Recommendations 

irk k  Lay  the  groundwork  for  future  design  and  price  competition 
through  production  and  for  ready  replacement  of  old  design; 
by  new- generation  equipment  by  ensuring  the  interchangeabil¬ 
ity  of  similar  equipments  intended  for  similar  applications. 
Accomplish  this  by  including  (or  by  requiring  prime  contrac¬ 
tors  to  include)  mechanical,  electrical,  and  environmental 
interface  standards  for  each  unit  as  a  part  of  military 
electronic  equipment  specifications. 

Require  design  interchangeability  when  production  competi¬ 
tion  or  design  upgrading  is  foreseen  as  desirable  or  likely. 
Equipment  classes  that,  by  virtue  of  large  dollar  volume  or 
rapid  technological  growth,  are  judged  ripe  for  initial  appli¬ 
cation  of  interface  standardization  are:  airborne  communica¬ 
tion,  navigation,  identification  and  weather  radar  equipments; 
vehicular  communication  equipments;  and  modular  electronics 
packages  for  tactical  missiles. 

kkk  Modify  approval  processes  for  engineering- change  proposals 
to  expedite  incorporation  by  suppliers  of  internal  design 
improvements  to  enhance  reliability  and  performance  or 
inclusion  of  new  technology  to  meet  competition  during  the 
procurement  cycle  and  even  after  deployment,  if  the  sup¬ 
pliers  are  called  upon  to  maintain  their  equipment.  But  keep 
rigid  control  over  interface  configurations  to  ensure  inter¬ 
changeability. 

kkrk  Obtain  multiple  developments  of  equipments  conforming  to 
interface  specifications.  Where  the  potential  market  for 
the  equipment  is  large  enough,  encourage  industry- financed 

irkk  Highest  priority;  ★★  high  priority;  ★  priority. 
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development;  otherwise,  procure  multiple  developments  under 
Government  contracts. 

★ *★  Facilitate  Government  testing  and  qualification  of  designs 

offered  in  compliance  with  the  specifications,  whether  or  not 
the  designs  were  developed  under  Government  contract.  Plan, 
prepare,  and  provide  for  retesting  and  requalification  of  modi¬ 
fied  designs  submitted  in  production  competitions  subsequent  to 
the  initial  competition. 

To  overcome  the  potential  problem  of  spare-parts  stocking  and 
field  repair  of  multiple  equipment  configurations,  make  use  of 
depot  repair  or  supplier  maintenance  under  warranty.  In  the 
field,  replace  rather  than  repair  failed  replaceable  units  of 
equipment.  Include  warranty  requirements  when  initiating 
deve lopment. 

*★  To  achieve  multiple- source  availability ,  rely  on  performance 
specifications  plus  environmental  and  interface  requirements 
(i.e.,  "form-f it- function"  specifications)  to  define  equip¬ 
ment,  rather  than  imposing  detailed  specifications  on  parts, 
processes,  materials,  and  internal  configuration. 

★  To  broaden  the  markets  for  competitive  suppliers,  encourage 
the  evolution  of  multi-Service  interface  standards. 

The  expected  benefits  of  these  steps  are: 

-  Pressure  of  competition,  and  expedited  approval  of  internal  con¬ 
figuration  changes,  will  encourage  continuous  improvement51  in  the 
capabilities  of  an  equipment,  as  well  as  cost  reduction  and  design 
simplification,  throughout  the  equipment’s  procurement  and 
possibly  its  deployment  history. 

-  Interchangeability  of  competing  equipments  will  provide  management 
alternatives ,  should  one  supplier  slip  his  delivery  schedule  or 
default. 

Highest  priority;  **  high  priority;  ★  priority. 
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Provision  of  standard  interfaces  will  stabilize  electronics  in¬ 
stallation  provisions  in  ships  and  aircraft,  and  will  reduce  the 
need  for  modification  of  the  installation  to  retrofit  equipment 
of  improved  design. 

Generation  interchangeability  among  electronic  equipment  will  re¬ 
duce  weapon-system  managers'  dependence  upon  on-schedule  comple¬ 
tion  of  development  of  improved  electronic  subsystems;  existing 
designs  in  production  provide  a  fallback  to  which  recourse  can  be 
had  without  modifying  the  installation  provisions. 

Increased  inter-Service  interchangeability  of  equipment  will  ex¬ 
pand  the  market  of  equipment  suppliers,  as  well  as  provide  more 
sources  for  buyers  in  the  Services. 

The  continued  competition  will  not  only  reduce  the  need  for  the 
extensive  and  costly  reprocurement  documentation  currently  pur¬ 
chased  when  there  is  only  a  single  design  and  a  single  supplier, 
but  will  mitigate  the  need  for  Government  monitoring  and  micro- 
management  of  the  details  of  development  and  the  production 
processes  of  suppliers. 

Because  of  the  resulting  smaller  sizes  of  procurements,  errors  in 
estimating  costs  or  schedules  and  premature  commitments  to  un¬ 
realizable  designs  by  either  buyers  or  sellers  will  not  be  so  dis¬ 
astrous  as  they  are  today. 
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F.  PRODUCTION 

1.  Competition  in  the  Production  Phase 
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Arguments  in  favor  of  extending  design  and  price  competition  through 
production  have  been  presented  in  Section  III-E,  ’’Design  to  Facilitate 
Competition.”  Extending  competition  into  production  requires  splitting 
what  would  have  been,  under  current  practices,  large  aggregated  procure¬ 
ments  into  smaller  parts ,  and  sequentially  putting  these  parts  up  for 
competition.  Such  splitting  runs  contrary  to  the  often-heard  assertion 
that  ’’the  only  way"  to  reduce  unit  costs  is  to  increase  equipment  quanti¬ 
ties.  There  is  another  way,  repeatedly  demonstrated  in  the  commerc  \al 
world:  competition.  Ihe  questions  remain  as  to  whether  the  sort  of  com¬ 
petition  suggested  above  would  bring  about  real  dollar  savings,  and 
whether  such  savings  would  be  adequate  to  offset  the  added  front-end 
costs  of  multiple,  competing  developments. 

Examples  are  at  hand  to  illustrate  that  splitting  large  production 
buys  and  sequentially  submitting  each  segment  to  price  competition  can 
save  considerable  money. 

With  85  percent  learning  curves  (a  typical  figure  for  electronics 
production),  the  average  unit  price  when  two  equal-size  buys  are  aggre¬ 
gated  is  theoretically  85  percent  of  what  it  would  have  been  had  the  buys 
been  made  separately.  With  four  equal  buys  aggregated,  the  theoretical 
fraction  would  be  72  percent.  On  the  other  side  of  the  coin,  merely  in¬ 
troducing  competition  may  bring  about  reductions  of  up  to  50  percent  from 
the  previous  price  of  a  product. 

Table  III-35  illustrates  the  impact  of  price  competition  on  price 
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and  learning  curve  for  seven  items,  five  of  which  were  electronic.  The 
competitor's  Nth  unit  price  is  seen  to  be  markedly  lower  than  the  orig¬ 
inal-source  Nth  unit  price  (N  is  the  number  of  units  delivered  by  the 
original  source  at  the  time  competition  takes  place),  but  his  learning 
curve  is  much  flatter.  Even  so,  the  cost  of  obtaining  the  first  half  of 
the  units  from  the  original  source  and  the  next  half  through  competition 
averages  82  percent  of  the  cost  of  buying  them  all  from  the  original 
source.  This  lends  credibility  to  the  idea  Chat  fragmenting  production 
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procurements  and  sustaining  competition  throughout  production  will  not 
only  not  increase  the  Government’s  production  costs,  but  will  also  produce 
substantial  production  cost  savings  that  can  offset  the  added  cost  of  de¬ 
veloping  competitive  designs. 

TABLE  III- 35.  IMPACT  OF  COMPETITION  ON  THE  PRICE3 
OF  SEVEN  REPROCURED  ITEMS b 


Competitive  Price  of  the 
Nth  Unit  as  a  Percentage 


Item 

of  Original- Source 
Price  of  the  Nth  Unit 

Original- Source 
Lea  miner  Curve 

1 

58% 

70.9% 

2 

40 

95.8 

3 

33 

87.4 

4 

41 

84.2 

5d 

64 

74.1 

6 

57 

78.8 

7d 

52 

95.7 

Average  49% 

83.8% 

Total  Cost  of  N  Units  From  A, 
Plu9  N  Units  From  B,  as  a 
Competitive  Pen.,  .v.  age  of  Total  Cost  of 


Learning  Curve 

*N  Units  Fi 

96.6% 

92.4% 

97.2 

72.6 

99.8 

72.5 

95.9 

76.8 

90.9 

95.9 

96.3 

88.5 

103.3 

76.3 

97.2% 

82.1% 

aConstant  dollars. 

^Source:  Ref.  52. 

CA  =  original  source;  B  =  successful  competitor. 
dNonele  tronic . 


Sustaining  design  competition  through  production  requires  Government 
procurement  strategies  that  differ  from  those  of  the  traditional  competi¬ 
tive  re procurement,  which  is  a  pure  price  competition  for  production  of  a 
single  selected  design.  Previous  losers  of  an  initial  competition  must  be 
offered  inducements  to  continue  upgrading  tneir  designs,  and  potential  new 
competitors  must  be  offered  inducements  to  develop  competing  designs.  The 
development  effort  required  may  impose  substantial  financial  risks  on  the 
developers.  To  encourage  such  risk-taking,  the  Government  must  provide 
credible  assurance  that  the  risk-taker  has  a  reasonable  expectation  of 
realizing  rewards  by  winning  future  competitions.  This,  in  turn,  requires 
Government  assurance  that  all  qualified  designs  will  be  admitted  to  future 
competition,  and,  when  possible,  that  future  competitions  will  be  held. 
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As  an  alternative  or  complementary  strategy,  the  Government  can 
encourage  continuing  design  and  price  competition  partly  at  its  own  ex¬ 
pense  by  making  its  awards  not  on  a  winner- take-all  basis,  but  by  awarding 
fractions  of  each  buy  to  a  limited  number  (two  or  three)  of  the  competi¬ 
tors  in  proportion  to  the  merits  of  their  designs  and  prices. 
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While  it  has  been  observed  that  a  winner- take-a  11  strategy  produces 
maximum  cost  savings  in  first  reprocurement  (pure  price)  competitions,  the 
split-award  strategy  has  the  advantage  that  it  puts  suppliers  on  notice 
that  there  are  ensured  competitive  sources  for  future  buys,  and  it  offers 
them  an  incentive  to  improve  designs  and  reduce  prices.  Thus,  award- 
splitting  may  be  the  best  Government  strategy  for  long-run  savings  in 
multiple  sequential  procurements. 

a .  Findings 

•  Production- price  competition  generally  reduces  the  cost  of  mili¬ 
tary  electronics.  The  cost  reductions  resulting  from  competition 
often  substantially  exceed  those  realizable  by  extending  the 
price-quantity  projections  ("learning  curves")  of  the  original 
suppliers. 

•  Aggregating  requirements  into  a  single,  large,  multiyear  procure¬ 
ment  not  only  precludes  the  cost  reductions  obtainable  from  com¬ 
petition  but  also  makes  the  Government  vulnerable  to  upward  price 
pressures  by  the  selected  supplier  and  induces  design  stagnation. 

•  The  potential  benefit  of  competition  in  reducing  production  costs 
is  larger  in  high- dollar- value  items  and  large  contracts  than  in 
smaller  ones,  but  is  seldom  pursued  because  of  inhibitions 
against  incurring  the  additional  front-end  costs  associated  with 
establishing  a  second  source. 

•  Production  competition  nay  be  expected  to  cut  a  substantial 
amount,  such  as  20  percent,  from  total  production  costs.  The 
potential  savings  are  often  more  than  adequate  to  completely 
finance  a  competitive  development,  depending  on  the  ratio  of 
development  costs  to  production  costs  and  on  the  period  over 


which  planned  procurements  are  to  take  place.  That  period  is 
often  determined  by  factors  such  as  budget  limits  and  the  need 
for  naintaining  the  defense  industrial  base  rather  than  by  opti¬ 
mum  production  scheduling;  however,  tne  high  cost  of  accomplish- 
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ing  these  other  objectives  should  be  reconsidered. 

•  Where  feasible,  carrying  on  design  competition  as  well  as  price 
competition  through  production  will  encourage  a  succession  of 
technological  improvements  to  the  product  that  will  mitigate  the 
pressures  for  drastic  design  changes.55 

•  Sustaining  design  competition  through  production  requires  Govern¬ 
ment  procurement  strategies  that  differ  from  those  of  the  tradi¬ 
tional  competition  for  production  of  a  single  selected  design. 
Losers  of  an  initial  competition  must  be  offered  inducements  to 
continue  upgrading  their  designs,  and  potential  new  competitors 
must  be  offered  inducements  to  develop  competing  designs.  The 
development  effort  required  may  impose  substantial  financial 
risks  on  the  developers.  To  encourage  the  taking  of  such  risks, 
the  Government  must  be  able  to  provide  credible  assurance  that 
such  risk-taking  has  reasonable  expectation  of  realizing  rewards 
by  winning  future  competitions.  A  concerted  effort  should  be 
made  to  identify  systems,  subsystems,  and  components  to  which 
this  approach  is  applicable.50’54 

b.  Recommendations 

Where  the  quantity  to  be  bought  is  large  enough,  depart  from 
the  conventional  approach  of  aggregating  procurements  into  a 
single  large  buy  intended  to  take  advantage  of  "learning 
curves."  Instead,  fragment  the  procurements  into  sequential 
buys,  inviting  design  and  price  competition  on  each  buy  by 
the  several  suppliers  of  qualified  interchangeable  equipments. 

★★  The  Government  must  assure  prospective  suppliers  that  there 
will  be  future  design  and  price  competition.  One  method  of  so 

irk k  Highest  priority;  kk  high  priority;  k  priority. 
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doing  is  to  analyze  and  publish  future  needs  and  a  schedule 
of  planned  competitive  buys. 

The  Government  must  provide  assurance  that  new  or  improved  de¬ 
signs  will  be  given  full  consideration  in  future  competitions 
if  they  meet  the  form,  fit,  and  function  requirements  that  en¬ 
sure  interchangeability  with  prior  designs.  This  implies  the 
need  for  inclusion  of  interface  requirements  in  Government 
specifications. 

+**  The  Government  must  offer  to  perform  and  must  be  prepared  to 

perform  laboratory  tests  and  evaluations  of  the  actual  hardware 
prototypes  offered  by  bidders  or  prospective  competitors  in 
ord^r  to  qualify  the  designs  for  current  and  future  competi¬ 
tion. 

★  When  it  is  desirable  and  necessary  to  sustain  competition, 

award  fractions  of  each  buy  to  two  or  three  competitors  in  pro¬ 
portion  to  the  merit  of  their  respective  designs  and  prices, 
rather  than  making  the  award  on  a  winner- take-all  basis. 

2 .  Re procurement 

In  previous  paragraphs  we  have  recommended  techniques  for  maintaining 
hardware  competition  by  competitive  procurement  of  internally  different 
but  interchangeable  equipment  designs.  There  is  another,  traditional, 
method  of  getting  competition  that  is  used  with  varying  degrees  of  success 
by  the  electronics  procurement  activities  of  three  Services:  second- 
sourcing  of  a  single  design.  The  purpose  of  this  section  is  not  to  com¬ 
ment  on  the  merits  cf  second-sourcing,  but  to  suggest  the  application  of 
an  incentive  to  improve  the  efficacy  of  the  process. 

Under  current  procurement  practices,  the  Government  attempts  to  re¬ 
duce  its  dependence  on  a  single  source  of  supply  by  buying  from  the  orig¬ 
inal  supplier  a  costly  group  of  items  that  makes  it  possible  to  reprocure 
equipment  from  another  source  competitively: 
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-  Parts  lists 

-  Engineering  drawings 

-  Specifications 

-  Special  production  tools  and  test  equipment 

-  Methods 

-  Facility  plans 

-  Material  lists 

-  Qualified  vendor  lists 

-  Data  lists. 

Despite  the  purchase  of  this  reprocurement  package,  the  history  of 
reprocurement  is  replete  with  failures  such  as  AN/UYK-7,  NTDS  displays, 
and  FADAC,  although  there  have  also  been  some  notable  successes,  particu¬ 
larly  with  Army  communication  equipment.  Failure  begins  when  the  second- 
source  contractors  find  it  impossible  to  build  the  equipment  to  the  draw¬ 
ings  and  with  the  tools  supplied,  and  at  the  same  time  meet  the  specified 
performance  requirements.  Frequently,  this  comes  about  because  of  subtle 
errors  and  omissions  in  the  drawings  and  process  specifications.  The 
Government,  having  undertaken  reprocurement  as  a  technique  for  reducing 
costs,  is  then  reluctant  to  relax  specifications  or  approve  cost- increase 
engineering  design  change  proposals  that  would  resolve  the  conflict.  In 
consequence,  the  contractor  either  loses  money  and  delivers  or  elects  to 
default.  Such  cases  frequently  end  up  before  the  Armed  Services  Board  of 
Contract  Appeals,  which  awards  for  the  contractor  on  the  basis  that  con¬ 
tractual  requirements  were  internally  inconsistent,^  and  the  hoped-for 
reduction  in  price  vanishes. 

The  use  of  sustained  competition  between  two  or  more  interchangeable 
designs,  as  previously  recommended,  would  eliminate  the  need  for  the 
Government  to  approach  reprocurement  in  the  current,  often  unsatisfactory 
way.  But  where  it  is  necessary  to  stick  with  a  single  design  rather  than 
permit  multiple  competing  interchangeable  designs,  the  process  of  informa¬ 
tion  transfer  needs  to  be  improved.  That  it  can  be  improved  is  clear  from 
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the  success  of  profit-motivated  second- sourcing  within  industry,  of  which 
there  is  a  great  deal. 

Managers  in  Government  and  industry  indicate  that  original  developers 
of  equipment  are  usually  reluctant  to  provide  all  the  information  others 
would  need  to  build  that  equipment.  This  reluctance  is  attributed  to  a 
dislike  of  encouraging  competition,  to  the  detriment  of  the  developers’ 
profits,  in  the  production  of  equipment  currently  supplied  solely  by  the 
developers.  Thus,  drawings  and  specifications  for  Government  use  in  re¬ 
procurement  may  be  missing  or  inadequate.  Even  when  they  are  adequate,  a 
second  source  may  have  difficulty  interpreting  them  and  implementing  the 
required  manufacturing  processes.  To  encourage  the  transfer  of  informa¬ 
tion  from  developer  co  second  source  through  the  provision  of  good  draw¬ 
ings  and  engineering  assistance,  it  appears  that  the  rewards  for  doing  a 
good  job  and  the  penalties  for  doing  a  bad  one  need  to  be  strengthened. 

To  this  end,  it  is  appropriate  that  the  reprocurement  data  package  called 
for  by  the  Government  emphasize  substance  as  opposed  to  format,  and  that 
the  data  be  paid  for  in  installments:  a  nominal  initial  payment  when  an 
acceptable  data  package  is  delivered,  and  subsequent  additional  payments 
payable  only  upon  delivery  of  each  acceptable  equipment  by  a  new  supplier 
to  whom  the  data  package  has  been  furnished. 

Discussions  with  industrial  executives  indicate  the  potential  accept¬ 
ability  of  such  an  arrangement.  They  agree  that  it  would  provide  an  in¬ 
centive  to  them  to  offer  assistance  to  follow-on  sources,  and  that  receipt 
of  payments  based  on  items  successfully  delivered  by  these  sources  can 
provide  a  substantial  return  on  the  effort  required.  They  have  some 
doubts  about  the  strength  of  the  incentive  in  areas  where  they  have  here¬ 
tofore  held  a  virtual  technical  monopoly,  and  they  also  question  whether 
follow-on  sources  would  accept  proffered  technical  assistance. 


Find in c 


•  Where  a  single  design  must  be  procured  and  later  reprocured, 
experience  has  shown  that  dependence  upon  reprocurement  data 
packages  to  enable  a  second  source  to  reproduce  the  design  has 
often  resulted  in  failure  because  the  original  reprocurement 
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data  package  cannot  convey  all  the  information  required  for 
successful  production  of  the  design.  On  the  other  hand,  there 
is  abundant  commercial  experience  with  successful  licensing 
and  second- sourcing,  which  occurs  when  the  original  vendor  be¬ 
lieves  that  having  an  effective  second  source  is  essential  to 
his  own  profitability.  In  such  cases,  the  vendor  conveys  the 
information  not  just  via  a  data  package  but  also  via  actual 
people- to- people  contact. 

b.  Recommendation 

★★  In  selected  development  contracts  where  subsequent  competi¬ 
tive  reprocurement  is  anticipated,  the  Government  should  pro¬ 
vide  a  payment  to  the  developer  for  each  accepted  unit  pro¬ 
duced  under  Government  contract  from  the  developer’s  design 
by  a  supplier  other  than  the  developer.  This  payment  should 
constitute  a  deferred  part  of  the  compensation  for  the  re- 
procurement  data  package.  Such  a  contracting  procedure 
should  be  used  by  the  Government  on  a  trial  basis. 


★★★  Highest  priority;  ★★  high  priority;  ★  priority. 
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G.  MAINTENANCE 

Maintenance  is  recognized  as  a  significant  portion  of  the  life-cycle 
cost  of  electronics.  As  complexity  increases  and  as  manpower  becomes  more 
expensive,  maintenance  will  assume  even  greater  importance.  Accordingly, 
this  study  spent  considerable  effort  exploring  alternative  methods  of  re¬ 
ducing  the  cost  of  electronics  maintenance. 

In  this  section,  an  attempt  has  been  made  to  summarize  the  mainte¬ 
nance  philosophies  and  practices  of  the  Services  as  they  apply  to  elec¬ 
tronics.  Additionally,  the  directives  that  relate  to  maintenance  policies 
are  discussed.  With  this  as  background,  several  possible  areas  for  cost 
reduction  are  examined. 

The  thesis  is  developed  that  fostering  competition  among  sources  of 
maintenance,  particularly  depot  naintenance,  might  result  in  significant 
cost  reduction. 

With  respect  to  field  maintenance,  several  approaches  are  explored. 

It  seems  apparent  that  the  present  trend  toward  shifting  field  maintenance 
back  to  the  depots,  when  possible,  will  be  salutary,  although  it  must  be 
done  in  the  overall  logistics  context.  The  problem  of  high  turnover  among 
enlisted  personnel  is  examined  along  with  the  attendant  high  cost  per  man- 
year  of  actual  work  brought  on  by  the  recent  pay  increases  and  by  the  ex¬ 
pensive  training  approaches  followed  by  each  of  the  Services.  The  possi¬ 
bility  of  better  utilization  of  first-term  enlistees  through  changes  in 
training  and  through  the  use  of  better  job  performance  aids  is  discussed. 
Finally,  a  number  of  recommendations  are  made  for  reducing  maintenance 
cost. 

1.  Electronic  Equipment  Maintenance  in  the  Services  and  Factors  in 
Maintenance  Policy 

a.  Army  electronic  equipment  maintenance. 56  AR  750-1  is  the  prin¬ 
cipal  document  prescribing  Army  equipment  maintenance  concepts  and  poli¬ 
cies.  This  regulation  identifies  two  basic  activities  within  the  equip¬ 
ment  maintenance  function:  maintenance  engineering  and  maintenance 
operations.  Maintenance  engineering  involves  development  of  maintenance 
support  concepts,  prescription  of  required  maintenance  operations,  design 
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of  maintenance  support  structures  for  end  items,  preparation  of  technical 
guidance,  and  analysis  of  operating  experience.  Maintenance  operations 
encompass  the  physical  performance  of  tasks  such  as  inspection,  servic¬ 
ing,  adjustment,  alignment,  repair,  overhaul,  rebuilding,  and  modification 
of  equipment. 

Army  maintenance  operations  are  divided  into  five  echelons.  Echelons 
1  and  2  are  at  the  organization  level  and  are  concerned  with  minimal  pre¬ 
ventive  maintenance  and  checkout,  simple  diagnosis,  and  remove  and  replace 
operations.  Echelon  3,  direct  support,  is  performed  by  units  assigned  to 
installation,  division,  or  major  commanders.  Direct  support  units  (DSUs) 
exchange  parts  with  the  using  organization,  repair  items  requiring  simple 
tools  and  equipment,  and  provide  technical  support  to  users.  At  Echelon 
4,  general  support  units  (GSUs)  do  more  complicated  repairs  that  do  not 
require  restoration  to  original  manufacturer  tolerances  or  standards.  The 
above  levels  are  sometimes  characterized  as  "direct”  maintenance.  Depot 
maintenance  (Echelon  5)  is  considered  "indirect"  maintenance  and  is  per¬ 
formed  by  industrial- type  activities  operated  by  the  Army  (organic  depots) 
or  on  contract  with  commercial  firms. 

On  a  given  item  of  equipment,  it  is  the  responsibility  of  the  mainte¬ 
nance  engineering  activities  within  the  Army  Materiel  Command  (AMC)  to 
determine  the  exact  maintenance  functions  to  be  performed  at  the  various 
echelons  discussed  above.  These  are  prescribed  on  maintenance  allocation 
charts  (MACs),  which  are  developed  as  part  of  the  maintenance  support 
planning  process. 

Organizational  maintenance  is  performed  almost  exclusively  by  Army 
enlisted  personnel.  In  the  DSUs  and  GSUs,  U.S.  civilians  and  foreign 
nationals  may  be  employed  to  augment  the  basic  capability  provided  by 
military  personnel. 

Practically  all  organic  depot  maintenance  in  the  CONUS  is  performed 
by  U.S.  Civil  Service  employees;  in  overseas  areas  the  bulk  of  the  em¬ 
ployees  in  depot  maintenance  are  civilian  foreign  nationals.  The  facil¬ 
ities  overseas  are  either  U.S.  Government  owned  and  operated  or  U.S. 
Government  owned  or  leased  and  contractor  operated. 
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Long-range  workload  programming  procedures  are  not  employed  in  Army 
maintenance  echelons  below  the  depot  level.  Manpower  is  authorized  in 
these  units  on  the  basis  of  the  number  and  type  of  organizations  to  be 
supported  and  experience  with  past  workloads.  In  the  depots,  however,  the 
Army  uses  comprehensive  workload  programming  procedures  to  reconcile  work¬ 
load  and  manpower  requirements  and  the  funds  available.  The  administra¬ 
tion  of  most  of  the  electronics  depot  maintenance  programming  procedures 
is  a  responsibility  of  the  Army  Electronics  Command  ( AECOM ) ,  Ft.  Monmouth, 
New  Jersey,  a  major  subordinate  command  of  the  Army  Materiel  Command. 

AECOM  has  centralized  commodity  management  responsibility  for  virtually 
all  electronics  except  electronics  for  missile  systems. 

Although  the  electronics-oriented  depots  do  not  report  directly  to 
AECOM,  that  command,  through  its  inventory  control  and  maintenance  staff 
activities,  develops  workload  programs  for  the  CONUS  depots  and  maintains 
information  on  workload  accomplishment.  AECOM  also  coordinates  on  elec¬ 
tronics  depot  maintenance  work  performed  overseas. 

Practically  all  maintenance  on  missile  guidance  systems  and  compo¬ 
nents  is  performed  in  CONUS  Army  depots  or  on  contract.  The  Army  Missile 
Command  (AMICOM),  Huntsville,  Alabama,  also  an  AMC  major  subordinate  com¬ 
mand,  performs  functions  related  to  this  equipment  comparable  to  those 
performed  by  AECOM  for  the  remainder  of  Army  electronic  equipment.  The 
missile  maintenance  work  is  accomplished  at  the  Letterkenny,  Anniston, 
Pueblo,  and  Red  River  Army  depots. 

With  the  exception  of  maintenance  on  missile  guidance  systems  and 
components,  Army  electronics  depot  maintenance  in  the  CONUS  is  performed 
at  three  depots:  Tobyhanna  Army  Depot,  Tobyhanna,  Pennsylvania;  Lexington- 
Blue  Grass  Army  Depot,  Lexington,  Kentucky;  and  Sacramento  Army  Depot, 
Sacramento,  California. 

There  is  a  very  limited  use  of  private  commercial  contract  capabil¬ 
ities  to  perform  maintenance  functions  below  the  depot  level.  The  thrust 
of  Army  policy  for  these  echelons  is  that  contract  maintenance  should  be 
employed  (1)  to  handle  workloads  that  temporarily  exceed  the  capacities  of 
the  organic  facilities  and  (2)  when  the  work  is  so  complex  that  it 


requires  technical  qualifications  generally  available  only  from  a  con¬ 
tractor.  Within  the  Army,  snail  contracts  are  let  by  field  commanders  to 
meet  requirements  under  the  criteria  set  forth  above. 

The  Army  has  chosen  to  place  on  contract  only  a  relatively  small 
amount--7  percent--of  its  depot  maintenance  work  on  electronic  equipment. 

b.  Navy  electronic  equipment  maintenance.^  NAVMATINST  4790.19  is 
the  principal  document  prescribing  Navy  electronic  equipment  iraintenance 
concepts  and  policies.  Navy  maintenance  operations  are  divided  into  three 
categories--organizational,  intermediate,  and  depot  maintenance- -in  con¬ 
trast  to  the  Army’s  five  echelons. 

On  a  given  item  of  equipment,  it  is  the  responsibility  of  the  mainte¬ 
nance  engineering  activities  within  the  cognizant  Navy  systems  commands* 
comprised  in  the  Naval  Material  Command  (NMC)  to  determine  the  exact 
maintenance  functions  to  be  performed  on  their  electronic  equipment  at  the 
various  echelons.  These  are  prescribed  in  Source  Maintenance  and  Recover¬ 
ability  Standards  (SMRSs)  that  are  developed  as  a  result  of  maintenance 
engineering  analysis  in  conjunction  with  the  maintenance  support  planning 
process.  The  SMRSs  identify  each  repair  task  by  echelon  and  prescribe 
standards  for  repair.  These  standards  include  such  elements  as  methods 
and  practices  to  be  used,  tolerances  authorized,  and  wear  limits. 

Each  Navy  ship’s  company  should  possess  the  capability  to  maintain 
the  ship’s  equipment  at  the  first  echelon.  Larger  ships  such  as  aircraft 
carriers  and  guided-missile  frigates  have  intermediate  maintenance  units 
aboard.  In  addition,  intermediate  raintenance  repair  ships  and  land-based 
units  are  assigned  to  the  Atlantic  and  Pacific  Fleets  (LANTFLT  and  PACFLT). 

Organizational  maintenance  is  performed  exclusively  by  Navy  enlisted 
personnel;  intermediate  naintenance  by  Navy  enlisted  personnel,  U.S. 
civilians,  and  foreign  nationals.  Organic  depot  maintenance  is  performed 
almost  exclusively  by  U.S.  Civil  Service  employees. 

*There  are  four  hardware- oriented  systems  commands:  Naval  Air  Systems 
Command  (NAVAIR),  Naval  Ship  Systems  Command  (NAVSHIPS),  Naval  Ordnance 
Systems  Command  (NAVORD),  and  Naval  Electronic  Systems  Command 
(NAVELEX). 
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The  management  of  Navy  electronic  equipment  maintenance  is  highly 
decentralized.  Each  of  the  four  hardware- oriented  systems  commands  with¬ 
in  the  NMC  is  responsible  for  the  design,  development,  procurement, 
materiel  management,  maintenance  engineering,  refit/restoration,  altera¬ 
tion,  and  modification/modernization  of  its  assigned  electronic  equipment. 

Once  a  ship  has  been  built  and  NAVORD  and  NAVELEX  equipment  installed 
on  a  NAVSHIPS  hull  or  platform  along  with  NAVSHIPS  electronic  equipment, 
the  ship  becomes  the  responsibility  of  a  type  commander  (TYCOM)  in  the 
Atlantic  or  Pacific  Fleet.  The  TYCOMs,  in  conjunction  with  NAVSHIPS, 
which  manages  the  shipyards  (Navy  depots)  are  responsible  for  the  program¬ 
ming,  workloading,  and  financing  of  the  ship  depot  maintenance  program. 

NAVORD,  NAVELEX,  and  NAVSHIPS  participate  in  the  programming,  work¬ 
loading,  and  financing  of  the  ship  depot  maintenance  program  to  the  extent 
that  they  have  modernization/alteration  programs  for  electronic  equipment 
assigned  to  them.  The  TYCOMs  establish  strategic  priorities  and  make  the 
final  decisions  on  which  modernization/alteration  programs  will  be  accom¬ 
plished  vdien  their  ships  go  in  for  overhaul  and  repair.  Each  shipyard 
maintains  a  sophisticated  electronics  maintenance  capability  for  equipment 
on  its  assigned  classes  of  ships.  In  addition  to  supporting  the  TYCOMs, 
the  shipyards  also  perform  electronics  depot  maintenance  to  support  NAVORD, 
NAVELEX,  and  NAVSHIPS  electronic  equipment  refit  and  restoration  programs. 

NAVAIR  differs  from  NAVCxD,  NAVELEX,  and  NAVSHIPS  in  that  it  is 
directly  responsible  for  the  programming,  workloading,  and  financing  of 
the  depot  overhaul,  repair,  refit,  and  restoration  programs  for  aircraft 
and  their  support  systems/components. 

The  Aviation  Supply  Office  (ASO),  the  Navy  aviation  inventory  control 
point  for  components,  establishes  the  maintenance  requirements,  and  NAVAIR 
programs,  workloads,  and  finances  the  electronic  component  repair  programs 
at  the  Naval  Air  Rework  Facilities  (NARFs)  and  the  Naval  Avionics  Facility 
Indianapolis  (NAFI).*  NAVAIR  also  programs,  workloads,  and  finances  the 

*Naval  Avionics  Facility  Indianapolis  (NAFI)  is  a  specialized  activity 
responsible  for  design,  development,  prototype  production,  and  mainte¬ 
nance  of  airborne  electronic  components/avionics. 
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depot  maintenance  program  for  the  guidance  and  control  systems  on  air- 
to-air  and  air-to-ground  missile  systems  at  Naval  Weapon  Stations  and 
NARFs. 

As  in  the  Army,  very  little  maintenance  below  depot  level  is  done  by 
contractors.  For  the  last  three  years,  the  average  percentage  of  the 
total  Navy  electronics  depot  maintenance  program  placed  on  contract  was 
16.3  percent--ship-related  electronics  11.4  percent,  and  aircraf t- related 
electronics  22.9  percent. 

c.  Air  Force  electronic  equipment  maintenance. As  in  the  Navy, 
maintenance  production  in  the  Air  Force  is  divided  into  three  categories: 
organizational,  intermediate,  and  depot  maintenance.  The  criteria  for 
maintenance  production  at  each  echelon  are  essentially  the  same  as  those 
of  the  other  Services. 

During  the  initial  acquisition  phase,  Headquarters,  Air  Force 
Logistics  Command  (AFLC),  in  conjunction  with  the  Air  Force  Systems  Com¬ 
mand  (AFSC)  and  the  user  command,  determines  the  appropriate  repair  level 
designation  (echelons  of  maintenance)  criteria.*  The  exact  maintenance 
functions  to  be  performed  on  equipment  at  each  echelon  are  prescribed. 
This  information  is  published  in  Air  Force  Technical  Orders  (TOs),  de¬ 
veloped  as  a  part  of  the  maintenance  support  planning  process.  The  TOs 
identify  standards  for  repair,  which  include  such  criteria  as  ’’repair  and 
return”  versus  "discard  after  use”  or  "failure,"  methods  and  practices  to 
be  used,  tolerances  authorized,  and  wear  limits.^7 

Each  Air  Force  wing  possesses  the  capability  to  maintain  its  equip¬ 
ment  at  the  organizational  and  intermediate  levels.**  Organization  moxn- 
tenance  is  performed  almost  exclusively  by  Air  Force  enlisted  personnel. 


*The  Air  Force  Systems  Comnand  (AFSC)  is  responsible  for  all  research 
and  development  and  procurement  programs  for  new  weapon  and  support 
systems.  As  soon  as  weapon  and  support  systems  become  part  of  the  Air 
Fcrce  operational  inventory,  the  Air  Force  Logistics  Command  (AFLC) 
assumes  central  supply  and  maintenance  responsibility. 

**In  some  cases,  squadrons  operating  separately,  such  as  Air  Defense 
squadrons  operating  from  other  major  command  bases,  will  be  augmented 
to  contain  an  intermediate  level  as  well  as  an  organizational  level 
maintenance  capability. 
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At  the  intermediate  maintenance  level,  U.S.  civilians  and  foreign 
nationals  may  be  employed  to  augment  the  core  capability  provided  by  Air 
Force  enlisted  personnel.  Practically  all  of  the  organic  depot  mainte¬ 
nance  is  performed  by  U.S.  Civil  Service  employees. 

The  management  of  depot  electronic  equipment  maintenance  is  highly 
decentralized.  Each  of  the  five  AFLC  Air  Materiel  Areas  (AMAs)  is  re¬ 
sponsible  for  the  materiel  management  and  depot  maintenance  programming 
on  its  assigned  electronic  equipment.  The  AMAs  workload  and  program  the 
organic  and  inter-Service  specialized  repair  activities  (SRAs).  Each  or¬ 
ganic  electronic  equipment  SRA  is  workloaded  to  its  capacity,  and  the  re¬ 
maining  workload,  if  any,  is  placed  on  contract. 

The  Air  Force  placed  on  contract  34.5  percent  of  its  electronics 
depot  maintenance  workload  during  FY  1973.  The  Air  Force  has  taken  ad¬ 
vantage  of  the  fact  that  much  of  the  specialized  test  and  maintenance 
equipment  and  many  of  the  labor  skills  required  for  airborne  electronics/ 
avionics  maintenance  are  also  utilized  in  the  civilian  aircraft  industry. 
In  addition,  the  Air  Force  has  a  relatively  large  amount  of  electronic 
surveillance  equipment  (black  boxes)  and  electronic  countermeasure  equip¬ 
ment  maintained  by  the  original  manufacturing  contractors. 

d.  Factors  in  maintenance  policy.  The  previous  sections  have 
presented  a  summary  of  the  policies  and  practices  of  the  Services  with 
respect  to  electronics  maintenance.  In  order  to  make  recommendations 
about  cost  reduction  in  this  area  it  would  be  useful  to  know  what  present 
costs  are.  Unfortunately,  as  discussed  in  Sections  III-A-1,  3,  and  5, 

DOD  budgeting  and  cost  reporting  systems  make  it  very  difficult  to  deter¬ 
mine  the  cost  of  electronics  support.  Using  a  variety  of  assumptions, 
several  estimates  have  been  made,  however  (Appendix  B).  The  estimates 
range  from  $4.2  to  $6.8  billion  and  average  $5.4  billion.  Clearly,  elec¬ 
tronics  maintenance  is  expensive  and  is  getting  more  so  as  military  man¬ 
power  costs  increase  since,  as  indicated  in  Table  III- 36,  most  of  the 
maintenance  force  is  military.  What  can  be  done  to  control  this  cost? 

One  alternative,  discussed  in  Section  IV-A,  is  the  use  of  warranties; 
another,  the  use  of  improved  maintenance  aids,  is  discussed  later  in  th 
chapter . 
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TABLE  III- 36.  DOD  PERSONNEL  ENGAGED 
IN  ELECTRONICS  MAINTENANCE3 


Military 

Civilian 

Army 

42,741 

4,926 

Navy 

56,497 

8,127 

Air  Force 

73,345 

5,548 

Totals 

172,583 

18,591 

^Source:  Ref.  58. 

^Civilians  engaged  in  depot  maintenance ; 
the  number  of  civilians  at  other  levels 
is  not  known  exactly  but  is  small. 

The  introduction  of  competition  as  an  inducement  to  reducing  costs  is 

an  alternative  that  should  be  given  serious  consideration.  Competition 

among  organic  sources  and  between  organic  and  industrial  sources  does  not 

exist  in  any  meaningful  way  today.  Although  the  use  of  the  industrial 

fund  concept  gives  the  appearance  of  an  arms- length  negotiation,  the  fact 

is  that  alternative  sources  of  maintenance  are  not  generally  compared  and 

industry  is  resorted  to  only  after  organic  depots  are  fully  workloaded  or 

when  the  equipment  in  question  requires  specialists  unavailable  in  the 
58 

depots. 

Last  year  the  Commission  on  Government  Procurement  called  attention 
to  the  established  Government  policy  that  has  historically  favored  con¬ 
tracting  for  goods  and  services  rather  than  providing  them  from  within  the 
Government.  OMB  Circular  A-76  states  that  the  Federal  Government  should 
rely  on  the  private  sector  for  goods  and  services  except  when  (1)  the  use 
of  commercial  sources  would  delay  or  disrupt  an  agency  program,  (2)  direct 
performance  is  required  for  combat  support,  military  training,  or  mobili¬ 
zation  readiness,  (3)  the  product  or  service  is  not  available  from  a  com¬ 
mercial  source,  (4)  the  product  or  service  is  available  from  another 
Government  agency,  or  (5)  procurement  from  a  commercial  source  will  result 
in  higher  cost  to  the  Government. 
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The  exception  in  Circular  A- 76  for  military  operations  is,  of 
course,  of  central  relevance  to  the  DOD.  The  DOD  policy  is  that  the  mili¬ 
tary  departments  will  be  self-sufficient,  insofar  as  possible,  in  provid¬ 
ing  organ izalional  and  intermediate  (O&I)  maintenance  ("direct"  mainte¬ 
nance)  for  combat  and  combat  support  activities.  Sources  for  maintenance 
at  the  O&I  level  for  other  than  combat  and  combat  support  activities  are 
to  be  determined  on  the  basis  of  (a)  the  need  for  a  training/rotational 
base  for  military  technical  personnel,  (b)  the  security  implications  in¬ 
volved,  and  (c)  cost-effect.' veness  considerations. 


The  DOD  policy  on  depot  maintenance  ("indirect"  maintenance),  as 
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stated  in  DOD  Directive  4151.1,  is  based  on  the  need  to  sustain  a  flex¬ 
ible  maintenance  base  capable  of  rapid  expansion.  Organic,  or  in-house, 
capability  is  to  be  kept  at  a  minimum  consistent  with  the  capability  to 
meet  military  contingencies.  The  general  guideline  is  that  the  organic 
depot  maintenance  capacity  will  be  planned  to  accomplish  no  more  than  70 
percent  of  the  mission-essential  workload  requirements  with  loading  of 
facility  capacity  at  a  minimum  rate  of  85  percent  on  a  40-hour  week,  one- 
shift  basis.  This  means  that  the  depot  could  somewhat  more  than  triple 
its  output  by  going  to  a  three-shift,  seven-day  week.  Although  the  polic v 
stresses  that  the  organic  capability  will  be  a  minimum  consistent  with  the 
above,  other  reasons  for  keeping  depot  maintenance  ir  house  are  indicate'  : 

1.  To  retain  or  upgrade  technical  ability  within  the  military  Ser¬ 
vice  or  permit  effective  performance  of  the  military  mission. 

2.  To  provide  necessary  experience  and  information  on  the  military 
requirement,  design  specifications,  performance  evaluations,  a:;': 
the  review  and  control  of  costs. 

3.  To  develop  the  technical  competency  necessary  to  conduct  analy 
ical  evaluations  of  maintenance  criteria,  specifications,  and 
performance  data  that  are  necessary  to  ensure  improved  perform 
ance  of  military  equipment. 


Such  criteria  allow  wide  discretion  in  deciding  whether  an  activi 
should  be  done  in  house  or  be  contracted  out.  Considering  alternative 
to  organic  maintenance  is  an  extremely  sensitive  matter,  because  chang< 
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may  affect  employment  in  existing  Government  facilities.  Government 
employee  unions  are  understandably  concerned  about  this  when  Civil- 
Service-  operated  depots  are  involved. 

Even  if  one  considers  all  depot  electronics  maintenance  as  mission- 
essential,  only  the  Air  Force  is  meeting  the  70  percent  criterion  of  DOD 
Directive  4151.1.  Air  Force  electronics  maintenance  is  35  percent  under  ' 

contract.  The  Army  figure  is  7  percent,  and  the  Navy  figure  is  11  per¬ 
cent  .  v 

Given  the  condition  of  the  DOD’s  cost  accounting  systems  (Sections 
III- A- 3  and  III-A-5),  it  is  quite  difficult  to  obtain  meaningful  cost 
comparisons  between  contractor  and  in-house  maintenance.  The  Army  Elec¬ 
tronics  Command  (AECOM)  conducted  studies  in  1968  and  1969  to  compare 
costs  at  three  organic  depots  with  the  costs  of  two  contractors.00  These 
studies  were  somewhat  inconclusive  because  of  heavy  contractor  start-up 


costs  during  1968,  which  required  considerable  extrapolation  to  arrive  at 


an  estimate  of  long-range  costs.  Also,  the  1969  analysis  was  incomplete 
because  material  costs  were  excluded.  If  the  studies  are  accepted  at 
face  value,  they  would  suggest  an  8-12  percent  saving  if  electronics 

i 

maintenance  is  done  on  contract  in  large  volume.  This  probably  assumes 
a  production- line  process  and  includes  no  reserve  capacity  retained 


for  surges  in  workload. 


*3 
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Another  effort  to  compare  organic  and  contract  costs  was  a  1972  Air 
University  thesis  analyzing  maintenance  of  nontactical  two-way  radio 
systems  at  125  Air  Force  bases. The  study  compared  the  anticipated 
cost  of  contract  maintenance  based  on  commercial  rates  negotiated  by  the 
Government  with  the  hypothetical  cost  of  organic  maintenance  and  concluded 
that  contract  costs  were  higher.  Although  the  analysis  was  extensive,  a 
number  of  the  assumptions  are  suspect.  In  determining  the  cost  to  the 
Government  of  contract  maintenance,  $2.5  million  was  added  to  the  contract 
cost  of  $6.8  million  to  cover  contract  administration  and  management;  this 
was  37  percent  of  the  total  contract  amount.  In  the  extreme  case  of  a 
separate  contract  for  each  base,  this  meant  that  $20,000  would  be  expended 
annually  by  the  Government  to  administer  a  contract  covering  the  services 
of  an  average  of  four  technicians. 
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If  the  contract  administration  figure  were  28  percent,  intuitively 
still  too  high,  the  conclusion  of  the  study  would  have  been  reversed, 
contract  maintenance  being  less  expensive.  Aside  from  the  validity  of 
the  assumptions,  the  conclusion  that  the  Air  Force  should  do  this  task 
in  house  because  it  would  be  7  percent  less  expensive  is  contrary  to  OMB 
Circular  A-76,  which  permits  a  new  start  in  house  only  if  it  saves  at 
least  10  percent. 

Another  interesting  but  admittedly  incomplete  data  source  is  a  recent 
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Boeing  proposal  for  MINUTEMAN  II  support.  Boeing  asserted  that  there 
could  be  a  saving  of  $539  million  over  a  10-year  period  from  personnel 
costs  alone.  The  proposal  considered  only  ’’not  military-essential”  posi¬ 
tions,  using  Malmstrom  Air  Force  Base  as  an  example.  No  change  was  sug¬ 
gested  in  Civil  Service  manning  or  in  the  medical  area.  The  net  reduction 
in  personnel  indicated  was  over  20  percent.  Boeing  based  this  reduction 
on  three  factors:  deletion  of  military  duties,  work/time  improvement,  and 
decrease  in  supporting-services  personnel.  It  should  be  noted  that  the 
specific  claims  made  in  the  Boeing  proposal  do  not  call  on  the  profit 
motive  as  a  driving  force.  The  savings  due  to  the  deletion  of  military 
duties,  to  a  better  trained  and  more  stable  work  force,  and  to  the  reduc¬ 
tion  in  support  staff  would  presumably  also  obtain  if  the  shift  were  to 
Civil  Service  instead  of  private  contractor.  Boeing  estimated  that  a 
military  man’s  time  on  the  MINUTEMAN  job  was  reduced  from  176  hours  per 
month  to  140  hours  per  month  because  of  military  duties  such  as  com¬ 
mander’s  call,  parades,  small-arms  military  events,  courts-boards,  and 
base  cleanup.  This  is  a  20  percent  reduction.  It  should  be  noted  that 
this  difference  is  under  control  of  the  military  and  most  of  it  could  be 
eliminated  in  many  locations  by  means  other  than  the  use  of  contractors. 


Boeing  assumed  the  average  service  life  of  working- level  personnel  to 
be  6  years  for  the  Air  Force  and  12  years  for  Boeing.  After  asserting 
that  Boeing  people  are  not  only  more  experienced  but  more  broadly  trained, 
the  proposal  arbitrarily  assigns  a  60  percent  productivity  to  Air  Force 
personnel  and  75  percent  to  Boeing  personnel.  The  proposal  assumes  a  10 
percent  loss  of  time  (12  months  over  10  years)  due  to  on-the-job  training 
for  military  personnel  and  1.25  percent  (1.5  months  over  10  years)  for 
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contractor  personnel.  Since  contractor  personnel  would  be  part  of  the 
local  economy  and  would  not  require  housing  and  other  services,  the  pro¬ 
posal  assumes  a  15  percent  reduction  in  supporting- services  personnel. 

Other  benefits  are  cited  but  not  included  in  the  summary  figures-- 
reduced  DOD  overhead,  reductions  in  support  and  training  bases,  and  cost 
avoidance  in  new-facility  construction. 

Recognizing  the  sensitivity  of  a  system  like  MINUTEMAN,  Boeing 
addressed  the  problem  of  the  commander’s  control  over  the  operation  and 
attempted  to  demonstrate  that  the  contractor’s  manager  could  and  would  be 
responsive  to  the  changing  requirements  of  the  commander  and  his  staff. 
With  respect  to  work  continuity,  no-strike  clauses  could  be  used  in  labor- 
management  agreements. 

The  Air  Force  has  reportedly  declined  to  pursue  the  possibility  of 
contractor  support  of  MINUTEMAN  bases  on  other  than  economic  grounds,  and 
it  is  not  the  purpose  here  to  challenge  that  decision.  It  is,  however, 
important  that  potential  cost  savings  be  examined  and  that  civilianization 
of  positions  not  military-essential  be  given  serious  consideration. 

The  average  cost  of  formal  training  for  all  enlisted  skills  in  the 
Services  is  officially  estimated  to  be  about  $11,000.  Training  costs  for 
some  electronic  specialties  are  estimated  to  be  over  $30,000.  If  all 
costs,  including  the  cost  of  on-the-job  training  were  considered,  these 
estimates  would  be  25-50  percent  higher.  The  median  length  of  service  for 
technicians  is  less  than  four  years,  given  an  initial  reenlistment  rate  of 
20  percent*  and  a  career  enlistment  rate  of  90  percent.  Thus,  depending 
on  the  specialty,  the  annual  cost  attributable  to  training  of  a  technician 
with  only  three  years'  experience  is  $3000- $10, 000.  Considering  that  the 
longevity  of  contractor  personnel  is  greater,  a  cost  advantage  exists  in 
this  area,  without  considering  the  fact  that  military  personnel  may  have 
military  duties  that  reduce  the  effective  time  they  are  able  to  be  actu¬ 
ally  on  the  job. 

*Data  for  FY  1972  suggest  that  the  reenlistment  rate  has  grown  to  30  per¬ 
cent.  This  may  reflect  one  of  the  positive  effects  of  voluntary  military 
service  or  the  depressed  state  of  the  economy,  and  it  may  be  temporary. 
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No  matter  how  expensive,  some  maintenance  tasks  must  be  performed  by 
uniformed  personnel.  These  personnel,  on  ships  and  overseas,  generate  a 
requirement  for  rotation  billets  in  CONUS.  One  way  to  reduce  the  number 
of  field  maintenance  personnel,  both  here  and  overseas,  is  to  move  as 
much  maintenance  as  possible  from  the  lower  levels  and  have  the  work  per¬ 
formed  in  depots.  The  Army  has  under  way  two  programs,  Direct  Supply  Sup¬ 
port  and  Maintenance  Support  Positive,  that  are  consistent  with  this 
objective.  These  programs  are  designed  to  speed  up  the  movement  of  equip¬ 
ment  components  between  field  units  and  depots  and  to  remove  from  the 
field  units  as  many  relatively  complex  naintenance  functions  as  possible. 
Problems  such  as  packaging  and  transportation  are  being  addressed.  The 
increased  use  of  warranties  would  also  help  to  reduce  the  need  for  skilled 
military  electronics  technicians  in  the  field.  Additionally,  there  have 

been  a  number  of  satisfactory  experiences  with  contractor  representatives 
63 

in  war  zones.  Generally  speaking,  reducing  the  need  for  a  uniformed 
maintenance  man  overseas,  by  whatever  means,  frees  a  stateside  position 
for  possible  civilianization. 

In  addition  to  rotation  requirements,  maintaining  a  surge  capability 

is  an  important  consideration.  For  example,  the  Air  Force,  which  operates 

the  undergraduate  pilot  training  wing  at  Vance  Air  Force  Base  almost 

entirely  by  contract  at  a  cost  per  pilot  trained  that  is  less  than  in  all 

other  similar  Air  Force  operations,  will  not  consider  converting  such 

operations  at  other  bases  to  contract.  The  reason  given  is  that  the  uni- 

64 

formed  maintenance  men  on  these  bases  nay  suddenly  be  needed  overseas, 
e.  Findings 

•  Annual  DOD  expenditures  for  electronics  maintenance  are  estimated 
to  approximate  those  for  production  procurement  (more  than  $5 
billion) . 

•  As  indicated  in  prior  findings,  electronics  maintenance  cost  visi¬ 
bility  is  needed  before  nanagement  action  to  reduce  cost  can  be 
maximally  effective.  DOD  cost  reporting  systems  do  not  now  pro¬ 
vide  this  visibility. 
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•  While  there  is  competition  in  the  procurement  process,  competi¬ 
tion  among  maintenance  sources  is  rarely  used  as  an  inducement  to 
reducing  costs.  Only  a  small  fraction  (about  H  percert)  of  the 
maintenance  effort  is  contracted,  while  more  than  ‘JO  percent  is 
performed  by  military  maintenance  personnel  and  activities.  >J 

•  The  DOD  policy  guideline  that  at  least  30  percent  of  mission- 
essential  depot  maintenance  be  done  on  contract  is  not  being 
followed  in  electronics  by  the  Army  and  Navy.  The  Army  contracts 
out  about  7  percent  and  the  Navy  16  percent.  (The  Air  Force 
figure  is  35  percent.) 

•  Because  of  increased  pay  rates  and  increased  turnover,  training, 
and  support  costs,  maintenance  by  uniformed  personnel  is  likely 
to  be  more  expensive  than  maintenance  by  contractors  or  Civil 
Service,  although  the  lack  of  good  cost  data  masks  the  issue. 

•  The  provision  of  maintenance  billets  at  U.S.  bases  to  accommodate 
rotation  of  military  personnel  from  overseas  compxicates  the  use 
of  civilianization  as  a  cost- reducing  technique.  Such  rotation 
billets  should  be  carefully  identified  as  a  cost  element  other 
than  maintenance  so  that  their  cost  can  be  properly  ascribed. 

•  The  present  accounting  system  does  not  allow  a  clear  separation  of 
true  maintenance  costs  from  costs  of  nonmaintenance  functions  per¬ 
formed  by  military  personnel  occupying  maintenance  billets.  Nor 
does  the  system  allow  a  cost  comparison  between  military  and  con¬ 
tractor  maintenance  or  between  two  different  military  facilities. 

f .  Recommendations 

+**  As  recommended  earlier,  institute  a  cost  accounting  svstem  that 
will  afford  visibility  of  the  maintenance  process  and  make  pos¬ 
sible  realistic  cost  comparisons  between  military  and  industrial 
maintenance.  Implementation  in  all  the  Services  of  the  Uniform 
Depot  Maintenance  Cost  Accounting  and  Production  Reporting 


Highest  priority;  ★*  high  priority;  *  priority. 
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System  (OSD  Instruction  7220.29)  would  be  an  important  part  of 
such  a  system. 

**  Provide  separate  accounts  for  functions  other  than  maintenance, 
such  as  the  use  of  U.S.  maintenance  billets  to  facilitate  the 
rotation  of  military  personnel  not  involved  in  maintenance,  or 
for  personnel  in  training. 

•kirk  Establish  alternative  sources  of  maintenance,  including  the 
maximum  feasible  amount  of  contractor  maintenance,  to  foster 
competition  and  resultant  efficiency  in  the  maintenance  process 
and  to  ensure  the  proper  utilizat'on  of  scarce  military  per¬ 
sonnel  in  the  present  zero-draft  environment. 

*★  Intensify  efforts  to  reduce  field  maintenance  by  shifting  com¬ 
plex  tasks  from  the  organizational  and  intermediate  levels  to 
the  depots,  taking  due  account  of  increased  turn-around  time 
and  transportation  problems. 

2.  Job  Performance  Aids  and  Maintenance 

As  indicated  earlier,  organizational  and  intermediate- level  mainte¬ 
nance  is  and  will  continue  to  be  a  problem  for  the  military.  Field  main¬ 
tenance  is  expensive  in  terms  of  money  and,  more  importantly,  in  terms  of 
readiness.  Using  contractors  and  warranties  may  improve  the  situation  in 
some  cases,  but  for  the  most  part  the  military  must  rely  on  a  field  main¬ 
tenance  force  composed  of  enlisted  personnel  with  a  median  level  of  expe¬ 
rience  of  less  than  three  years.  While  it  is  too  early  to  be  certain, 
because  of  the  end  of  the  draft  this  force  may  come  to  be  made  up  of  men 
of  lesser  educational  background  who  meet  relaxed  standard1:  on  Service 
mental  fitness  examinations. 

Considering  that  electronics  maintenance  men  spend  20  percent  of 
their  time  seeking  information  and  that  the  information  they  get  is 
often  inadequate,  one  area  of  possible  improvement  is  technical  documenta¬ 
tion.  Research  sponsored  by  all  three  of  the  military  departments  indi¬ 
cates  that  better  maintenance  can  be  done  if  technicians  use  job 

irk*  Highest  priority;  kk  high  priority;  ★  priority. 
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performance  aids  (JPAs);  that  is,  documents  or  devices  that  give  precise, 
step-by-step  instructions  for  each  task  or  that  otherwise  present  in  a 
concise  and  consolidated  manner  all  information  relevant  to  that  task. 
Although  some  of  the  techniques  investigated  appear  to  have  the  potential 
for  greatly  reducing  the  cost  of  maintenance  (perhaps  by  30  percent  or 
more^7)  and  improving  equipment  availability,  they  have  had  little  appli¬ 
cation  outside  the  laboratory. 

The  objective  of  a .1  the  efforts  has  been  to  provide  to  the  techni¬ 
cian  simple,  complete,  and  current  information  in  a  single  package,  with¬ 
out  the  need  for  cross-referencing  and  retention.  Fully  proceduralized 
JPAs  break  up  a  task  into  easily  remembered  steps  and  present  unambiguous 
directions  using  simple  English  and  relevant  illustrations.  A  well-de¬ 
signed  JPA  is  based  on  a  careful  analysis  of  the  task  the  technician  actu¬ 
ally  has  to  do  and  takes  into  consideration  the  amount  of  training  and 
experience  he  has  had.  While  one  would  assume  that  the  current  mainte¬ 
nance  documentation  would  do  just  this,  it  rarely  does.  In  the  process  of 
maintenance  documentation,  the  maintenance  manual  is  often  written  before 
the  equipment  has  been  produced  and  is  not  based  on  what  a  technician 
actually  must  do  to  make  repairs.  More  often  than  not,  the  manual  is 
descriptive  of  the  equipment  rather  than  being  oriented  toward  its  optimal 
maintenance.  In  analyzing  the  maintenance  actions  required  for  the  dop- 
pler  radar  systems  of  the  C-141,  the  Air  Force  found  that  the  isolation 
and  repair  of  one  malfunction  required  reference  to  165  pages  of  eight 
documents.  If  no  false  moves  were  made,  41  changes  in  document  location 

•  A  68 

were  required. 

Research  on  JPAs  has  been  summarized  a  number  of  times;  one  of  the 
most  recent  summaries  is  in  Price  et  al.^  Others  are  in  Foley^  and  in 
Shriver  et  al.  ^  For  the  most  part,  these  have  been  descriptive  summa¬ 
ries  rather  than  critical  reviews.  Rowan, 7^  in  a  study  associated  with 
Electronics-X,  attempted  to  evaluate  the  quality  of  selected  JPA  research 
projects  in  order  to  assess  the  claims  put  forward  for  this  general 
approach  to  maintenance  documentation  and  for  particular  JPAs.  Table 
III-37  summarizes  the  results  of  this  examination. 
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TABLE  III- 37.  EXPERIMENTAL  COMPARISONS  OF  INNOVATIVE  JOB 
PERFORMANCE  AIDS  WITH  CONVENTIONAL  DOCUMENTATION3 
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In  addition  to  the  studies  summarized  in  Table  III- 37,  a  number  of 
JPAs  have  been  developed  but  not  formally  tested.  The  largest  number  have 
been  procured  by  the  Air  Force  for  Vietnamization.  JPAs  have  been  pre¬ 
pared  for  the  UH-1H,  the  CH-47,  the  C-7A,  three  jet  engines,  a  refueling 
vehicle,  and  two  fire  trucks.  JPAs  for  organizational,  intermediate,  and 
depot  maintenance  are  being  produced  for  an  electronic  system  called  SEEK 
POINT. 

The  Army  has  developed  aids  for  the  following  systems:  an  armament 
pad  for  aircraft,  a  searchlight,  a  storage  battery,  a  tank  engine,  a 
gasoline-engine  water  pump,  and  a  TOW  launcher. 

The  Naval  Air  Systems  Command  (NAVAIR)  has  procured  fully  procedur- 
alized  JPAs  for  four  high-maintenance  subsystems  of  LAMPS  and  has  in 
process  the  development  and  test  of  fully  proceduralized  JPAs  for  the 
AQA-7  sonar  system.  NAVAIR  has  also  sponsored  research  on  JPAs  that  can 
be  used  by  personnel  of  differing  skill  levels  and  that  contribute  to  on- 
the-job  training  (OJT).  Unfortunately,  this  research,  which  dealt  with 
parts  of  the  trouble- plagued  AWG-10,  was  canceled  just  as  preliminary  re¬ 
ports  were  indicating  favorable  results. 

The  evidence  with  respect  to  JPAs  for  inexperienced  technicians  is 
convincing.  For  experienced  personnel  the  evidence  is  more  equivocal. 

In  all  the  experiments  and  field  tests,  inexperienced  technicians  per¬ 
formed  better  with  fully  proceduralized  JPAs  than  with  conventional  docu¬ 
mentation.  Often,  particularly  in  troubleshooting  situations,  the  inex¬ 
perienced  technicians — even  those  who  had  attended  the  prescribed  schools — 
were  unable  to  perform  at  all  using  conventional  manuals.  However,  they 
were  able  to  perform  with  minimal  errors  using  the  JPAs,  and  their  time  to 
repair  approached  the  time  experienced  technicians  required  when  the 
latter  used  either  conventional  or  experimental  documentation. 

Considering  the  overwhelming  evidence  from  the  experiments  and  field 
tests  cited  above,  it  seems  clear  that  nontroubleshooting,  fully  proce¬ 
duralized  JPAs  should  be  produced  and  widely  used.  Such  an  action  would 
result  in  significant  savings  in  the  cost  of  maintenance  in  that  the 
Services  would  be  able  to  make  more  effective  use  of  the  new  technician 
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who,  although  he  has  presumably  been  properly  trained,  spends  many  months 
on  the  job  before  he  performs  any  but  the  simplest  tasks. 

In  addition  to  the  benefits  derived  from  less  costly  rraintenance  and 
improved  equipment  reliability,  JPAs  offer  the  possibility  of  greatly  re¬ 
ducing  training  costs.  In  general,  each  of  the  Services  follows  the  same 
approach,  leading  to  the  assignment  of  a  man  to  an  organizational  or  inter¬ 
mediate-level  maintenance  position,  where  he  is  concerned  with  a  given 
system.  After  basic  training,  the  individual  is  given  an  extensive  course 
in  basic  electronics,  with  emphasis  on  general  theory.  He  subsequently 
receives  shorter  training  in  the  theory  and  maintenance  of  a  particular 
system  or  systems,  for  a  total  of  30  or  40  weeks  of  formal  training.  He 
is  then  assigned  to  a  maintenance  organization,  and  he  is  supposed  to  be 
capable  of  productive  work.  It  is  assumed,  of  course,  that  he  will  get 
additional  training  through  OJT.  Many  experienced  observers  indicate  that 
in  practice  the  system  does  not  work  this  way.  The  new  technician  is  un¬ 
able  to  use  the  conventional  nenuals  and  must  be  closely  supervised  if  he 
does  any  but  the  most  mundane  maintenance  task.  Since  OJT  is  often  in¬ 
adequate,  he  learns  only  if  he  is  highly  motivated  and  works  with  expe¬ 
rienced  personnel  who  are  willing  and  able  to  teach  him.  Given  the  re¬ 
enlistment  rate  and  the  length  of  training,  the  cost  of  effective  mainte¬ 
nance  finally  obtained  from  this  process  is  extremely  high.  The  research 
literature  on  JPAs  and  training  is  replete  with  studies  indicating  that 
even  men  of  lower  aptitude  can  carry  out  nontroubleshooting  maintenance 
tasks  with  minimal  training  if  they  are  furnished  with  properly  prepared 
JPAs.  If  no  change  were  made  in  formal  training  and  personnel  procedures, 
significant  improvement  would  still  result  from  providing  JPAs  to  the 
newly  assigned  technician,  if  only  on  selected  subsystems,  since  he  would 
immediately  be  able  to  be  productive. 

Even  greater  economy  would  result  if  the  training  procedures  were 
changed.  With  four  to  six  weeks  cf  training  in  the  use  of  tools  and  sup¬ 
port  equipment,  the  average  recruit  using  JPAs  should  be  able  to  perform 
72 

useful  work.  There  would  be  substantial  and  valid  objections  if  this 
were  the  only  change  made.  Even  though  the  evidence  indicates  that  new 
technicians  derive  a  good  deal  of  job  satisfaction  from  actually  doing 
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productive  work  with  JPAs,  effective  OJT  must  be  provided  if  they  are  co 
remain  motivated  and  to  increase  their  effectiveness.  With  the  exception 
of  some  of  the  earlier  studies,  JPA  design  has  not  included  training  ob¬ 
jectives.  A  number  of  studies  indicate  that  learning  nevertheless  does 
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occur.  Research  by  Post  and  Price  indicates  that  modified  JPAs  can  be 

an  effective  OJT  vehicle--one  that  would  be  relatively  independent  of  the 
teaching  abilities  and  inclinations  of  the  personnel  ordinarily  charged 
with  OJT  responsibility.  While  training- oriented  JPAs  would  probably  be 
more  effective  than  the  urual  OJT,  additional  provisions  would  be  needed 
for  career  progression  fjr  those  technicians  exhibiting  the  talent  and 
motivation  for  advancement.  Such  personnel,  should  they  choose  to  reen¬ 
list,  could  be  sent  to  school  after  a  tour  of  hands-on  maintenance  expe- 
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rience,  a  system  used  by  the  British  Navy. 

Another  problem  with  the  current  training  and  assignment  philosophy 
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is  the  difficulty  and  expense  of  cross-training.  Foley  points  out,  for 
example,  that  34  systems  are  the  responsibility  of  Air  Force  Specialty 
Code  328X4  (Avionic  Inertial  and  Radar  Navigation  Systems  Specialist). 

The  formal  training  for  this  career  field  is  37  weeks  long,  with  24  addi¬ 
tional  weeks  of  OJT.  After  this  training,  the  technician  is  effective 
only  on  the  system  for  which  he  has  received  OJT.  When  reassigned,  exten¬ 
sive  and  expensive  cross-training  is  required  before  the  technician  is 
again  effective.  Job  performance  aids  offer  the  potential  for  signifi¬ 
cantly  reducing  the  cost  of  cross-training. 

a.  Cost-savings  potential.  Hard  evidence  of  the  cost  savings  pos¬ 
sible  from  adopting  JPAs  is  difficult  to  develop.  In  the  F-4J  study,75 
a  simple  mathematical  model  of  a  work  center  was  bui.lt  to  explore  the  man¬ 
power  utilization  implications  of  introducing  JPAs  for  nontroubleshooting 
tasks.  Without  JPAs,  71  percent  of  the  inexperienced  labor  is  spent  ob¬ 
serving  and  assisting  experienced  technicians.  The  other  29  percent  can¬ 
not  be  accommodated  by  the  workload.  If  JPAs  were  used,  83  percent  of 
the  inexperienced  labor  would  be  performing  maintenance,  and  the  other  17 
percent  would  be  assisting.  The  availability  of  experienced  technicians 
for  complex  work  would  increase  52  percent,  the  maintenance  queue  would 
decrease  by  25  percent,  and  the  number  of  maintenance  actions  failing 

quality  assurance  would  decrease  by  75  percent. 
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In  the  PIMO  study,  system  effectiveness  estimates  were  also  rrade. 

It  is  pointed  out  that  simply  utilizing  time  now  spent  in  OJT  for  neinte- 
nance  using  JPAs  would  decrease  the  time  a  one-term  enlistee  sperds  in 
training  by  25  percent.  The  improved  performance  expected  with  JPAs 
could  improve  departure  reliability  by  50-65  percent  and  operational 
readiness  time  by  38-40  percent.  If  such  performance  measures  were  kept 
at  pre-PIMO  levels,  a  reduction  in  unscheduled  maintenance  manpower  of 
30-39  percent  would  be  possible. 

Should  JPAs  be  widely  adopted  and  formal  technical  training  reduced, 
very  significant  savings  could  be  made  in  training  costs.  The  PIMO  re¬ 
port  states  that  there  were  in  1969  approximately  5700  aircraft  mechanics 
assigned  to  flight-line  rraintenance  of  the  C-141A.  Assuming  only  1000  new 
men  per  year  due  to  turnover,  and  per-man  costs  of  $3500  for  OJT  and  $4500 
fcr  formal  training,  over  $7,000,000  per  year  could  be  saved  in  this 
specialty  by  cutting  training  from  28  to  4  weeks. 

About  one-fourth  of  total  DOD  enlisted  strength  is  in  direct  mainte¬ 
nance.  Of  this  force  of  about  600,000,  more  than  one-fifth,  or  120,000, 
must  be  replaced  each  year  because  of  turnover.  If  the  FIMO  calculations 
are  extended  to  this  entire  maintenance  force,  the  savings  would  be  nearly 
a  billion  dollars  per  year.  Such  an  extension  is  probably  not  warranted, 
since  JPAs  are  not  appropriate  for  every  maintenance  task.  On  the  other 
hand,  this  is  the  potential  cost  benefit  from  reducing  training  only  and 
does  not  include  the  benefit  from  better  equipment  availability  and  fewer 
zero-fault  removals. 

If  these  studies  are  at  all  reasonable,  the  cost-benefit  potential 
of  JPAs  is  indeed  very  large,  but  it  is  obtainable  only  by  making  changes 
that  cut  across  the  decisionmaking  structure  of  the  Services  and  by  making 
investments  that  do  not  clearly  accrue  to  the  benefit  of  the  investing 
agency. 

One  objection  to  JPAs  has  been  that  they  cost  more  than  conventional 
documentation  and  that  project  managers  faced  with  competing  requirements 
resist  their  adoption.  If  the  cost- savings  potential  of  JPAs  is  even  a 
small  fraction  of  what  is  claimed  by  proponents,  the  initial  cost  should 
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not  be  an  overriding  factor.  A  budget  quotation  submitted  to  AFLC  in 

% 

1971  for  completion  of  flight-line  JPAs  for  the  C-141  was  $1.3  million 
with  troubleshooting  aids  and  $800,000  without. McDonnell  Douglas  re¬ 
portedly  estimated  that  JPAs  for  the  F-15  would  cost  $45  million  versus  "* 

$35  million  for  conventional  documentation. 

Most  estimates  indicate  the  cost  at  100-125  percent  of  conventional  > 

documentation.  In  at  least  one  case,  SEEK  POINT,  estimates  of  JPA  cost 
were  less  than  the  estimates  for  conventional  manuals. 

If  JPAs  were  widely  adopted,  vheir  production  costs  would  undoubtedly 
come  down.  Current  JPA  estimates  from  contractors  accustomed  to  producing 
conventional  manuals  are  probably  inflated  because  of  uncertainty.  The 
industrial  base  for  this  kind  of  product  would  expand,  although,  fortu¬ 
nately,  there  are  currently  at  least  a  half-dozen  contractors  who  have 
demonstrated  capability  in  this  area. 

b.  Need  for  definitive  demonstration.  Considering  the  potential  of 
maintenance  aids  for  less  expensive  maintenance,  better  availability  of 
equipment,  and  better  use  of  manpower,  and  recognizing  that  human- factors 
RDD  money  is  very  limited,  it  is  difficult  to  understand  why  more  money 
has  not  been  spent  in  bringing  this  approach  to  a  point  where  a  clear-cut 
decision  as  to  its  merit  could  be  made.  The  PIMO  project  cost  $2.8  mil¬ 
lion.  All  of  the  AFHRL  effort  on  JPAs  since  1960  cost  a  total  of  $540,000. 

The  early  Army  HumRRO  work  on  JPAs  is  estimated  to  have  cost  less  than  $1 
million.  The  Navy  expenditures  on  research  in  the  area  are  about  $500,000 
to  date.  Thus,  approximately  $5  million  has  been  spent  in  developing  and 
evaluating  something  that  shows  promise  of  saving  many  times  that  amount 
annua lly . 

Achieving  efficient  cost-effective  rraintenance  is  a  system  problem 
involving  management  procedures,  procurement  methods,  maintenance  philos¬ 
ophy,  and  training  and  personnel  practices.  The  system  includes  a  number 
of  well-established  institutions  with  all  of  the  problems  inherent  in  a 
complex  process  that  has  developed  over  a  long  period  of  time; 

Perhaps  the  major  institutional  problem  in  getting  JPAs  adopted  is 
the  relation  of  life-cycle  cost  and  the  system  acquisition  process. 
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Inadequate  weight  is  given  to  the  potential  cost  savings  in  maintenance 
during  the  initial  decision  on  what  kinds  of  documentation  to  procure  for 
the  new  system.  Another  part  of  the  problem  is  on  the  contractor  side  of 
the  documentation  community.  Traditional  documentation  is  undarstood;  it 
is  easier  to  estimate  and  produce.  Given  the  low  priority  and  status  that 
documentation  activities  have  inside  the  major  weapon-system  firms,  it  is 
not  surprising  that  there  is  little  pressure  for  change.  It  seems  evident 
that  the  impetus  for  change  will  only  come  from  those  having  broad  enough 
responsibility  to  be  concerned  with  the  vdiole  life-cycle  process. 

The  numerous  small  research  studies  over  the  years  have  not  had  the 
influence  that  maintenance-aid  proponents  have  hoped  for.  Because  of  the 
general  difficulties  surrounding  hurran-factors  field  research  and  the 
small  sizes  of  the  samples  found  in  the  maintenance-aid  studies,  a  number 
of  doubts  remain,  particularly  in  the  troubleshooting  area.  There  are 
differences  of  opinion,  even  among  maintenance-aid  proponents,  about  the 
optimal  way  to  present  maintenance  data,  and  a  number  of  issues  need  more 
study.  Some  of  these  issues  have  been  discussed  in  this  report. 

To  settle  these  issues  and  to  gain  the  requisite  broad  institutional 
acceptance,  a  large-scale  series  of  well-planned  field  demonstrations  of 
JPAs  should  be  made  with  the  active  involvement  of  all  parties  concerned 
with  maintenance  documentation.  These  should  be  funded  well  enough  to 
ensure  that  the  results  will  be  logically  compelling  and,  if  positive, 
will  lead  to  acceptance  and  implementation. 

The  Air  Force  Human  Resources  Laboratory  has  proposed  in  Project 
INNOVATE  (Project  1194  of  Program  Element  63102F)  an  effort  that,  with 
some  modification,  would  serve  part  of  this  purpose.  This  project,  which 
has  not  been  funded,  would  compare  conventional  technical  orders,  SIMMs  or 
MDC-type  decision  aids,  and  fully  proceduralized  JPAs  and  would  provide 
answers  to  the  questions  of  whether  brief  technical  training  is  adequate 
with  JPAs  and  whether  JPAs  alleviate  the  cross-training  problem  within  a 
specialty.  It  would  also  compare  the  perfornence  of  personnel  of  differ¬ 
ing  aptitude  levels. 
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It  is  hoped  that  this  scale  of  effort  will  also  be  carried  out  in 
the  Army.  The  planned  Army  program  to  develop  and  demonstrate  information 
presentation  methods  tailored  to  various  commodity  groups  will  provide 
additional  focus  on  the  documentation  problem.  Reactivation  of  the  pre¬ 
viously  mentioned  Navy  work  involving  the  AWG-10  (ADO  W43-13X)  would  also 
contribute  to  progress  in  this  area. 

c.  Findings 

•  There  is  high  turnover  among  electronics  maintenance  personnel. 

The  training  period  is  long,  and  personnel  seldom  become  produc¬ 
tive  until  the  end  of  the  initial  enlistment  period.  The  median 
level  of  experience  is  less  than  three  years.  These  factors  re¬ 
sult  in  an  expensive  and  unproductive  maintenance  force,  high 
training  cost  (averaging  $3000- $10, 000  per  man-year),  and  high 
turnover. ^ 

•  A  training  sequence  in  which  a  trainee  first  learns  to  perform 
maintenance  tasks  cn  specific  equipments  and  defers  learning 
general  theory  gives  him  early  capability  to  do  productive  work 
and  prepares  him  for  later  advanced  study.  This  training  sequence 
is  the  reverse  of  the  current  process. 

•  Successful,  speedy,  ard  accurate  performance  of  maintenance  tasks 
by  green  technicians  can  be  made  possible  by  the  use  of  fully 
proc.eduralized  job  performance  aids. 

d.  Recommendations 

•kirk  Develop  fully  proceduralized  job  performance  aids  for  use  in 
routine  maintenance  of  new  weapons  systems  and  for  selected 
tasks  in  high-maintenance  portions  of  existing  systems. 

•kirk  Selectively,  on  a  trial  basis,  reorient  the  training  sequence 
for  electronics  technicians  so  as  to  provide  first  the  specific 
training  they  require  to  perform  maintenance  tasks  by  using 
proceduralized  aids  during  their  initial  enlistments. 


kirk  Highest  priority;  kk  high  priority;  ★  priority. 
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★  Increase  research  on  job  performance  aids  and  on  job-oriented 
training  to  enable  the  utilization  of  personnel  of  lower  ability 
levels  and  to  enhance  learning  on  the  job.  Apply  the  results  in 
selected  training  programs. 
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IV.  SPECIAL  TOPICS 


A.  WARRANTIES 


Take  calculated  risks.  That  is  quite  different 
from  being  rash. 

— George  Smith  Patton ,  Jr. 

The  following  points,  made  elsewhere  in  this  report,  need  restating 

here: 

1.  The  median  reliability  of  a  typical  class  of  equipment- -mili¬ 
tary  avionics-- is  less  than  one-fourth  that  which  can  be 
attained,  with  determined  effort,  in  superior  military  avionic 
equipment  of  equivalent  production  cost  and  complexity  (Fig. 

II-  5  and  Section  II- 1). 

2.  Reliability  often  declines  after  equipment  is  deployed  into 
the  operational  environment  (Section  III-D). 

3.  Reliability  specifications  are  frequently  not  based  on  what  is 
predictably  attainable,  and  hence  may  be  impossibly  high  or 
needlessly  low  (Section  III-D). 

4.  Reliability  development  to  meet  realizable,  though  severe, 
objectives  can  be  accomplished  both  before  and  after  equipment 
deployment  using  an  iterated  test-and-fix  process  accompanied 
by  Duane-curve  monitoring  of  achieved  reliability  (Section 

III- D). 

Past  procurements  have  not,  apparencly,  incorporated  adequate  in¬ 
centives  to  impel  the  military  electronics  contractor  to  strive  for  the 
attainable  reliability  during  equipment  development,  achieve  it  during 
production,  and  sustain  it  after  deployment.  In  fact,  there  exist 
counterincentives:  reliability  specifications  so  low  as  to  be  useless 
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or  so  high  as  to  be  unrealizable  (and,  hence,  meaningless  and  ignor- 
able);  rigid  configuration  control  that  inhibits  salutary  changes 
(Section  IV- D);  lucrative  spare  parts  contracts  that  reward  opera¬ 
tional  failures;  and,  most  important,  economic  pressures  to  minimize 
costs  of  development  and  production  regardless  of  the  support-cost 
outcome . 

One  promising  approach  to  providing  a  strong  incentive  for  con¬ 
tractors  to  develop  and  sustain  equipment  reliability  at  levels  that 
minimize  life-cycle  cost  is  the  application  of  contractor  maintenance 
warranties  (CMWs)  to  transfer  the  maintenance  burden  and  its  attendant 
risk  from  the  Government  to  the  contractor.  Such  warranties  would 
internalize  to  the  contractor  the  sum  of  the  production  and  the  main¬ 
tenance  cost,  and  thus  make  his  profit  dependent  not  just  on  production 
costs,  but  on  the  major  fraction  of  life-cycle  cost. 

The  contractor  maintenance  warranty  (CMW)  is  a  warranty  under  which 
the  contractor  undertakes  to  maintain  equipment  for  a  stated  number  of 
years  at  no  additional  cost  to  the  buyer.  The  warranty  period  is  usu¬ 
ally  3  to  5  years — a  long  period  in  comparison  to  both  the  typical  MTBF 
of  the  equipment  and  the  typical  period  during  which  equipment  is  ware¬ 
housed  before  being  put  into  service.  Under  some  variants  of  this  con¬ 
cept,  the  Government  would  have  an  option  to  renew  the  CMW  for  another 
period  of  several  years  upon  expiration  of  the  first  warranty  period. 

Experience  with  commercial  warranties  shows  them  to  be  successful 
where  there  is  a  sufficiently  large  quantity  of  warranted  units,  a 
predictable  distribution  of  operating  environments,  and  an  early  and 
rapid  feedback  of  operating  experience  with  the  units.  Under  these 
circumstances,  the  frequencies  of  failures  of  various  kinds  can  be 
established,  the  mathematical  expectation  of  loss  can  be  determined, 
and  speedy  corrective  actions  can  be  taken  in  current  production,  where 
necessary  to  prevent  serious  losses.  Under  such  conditions  the  war¬ 
rantor  can  reasonably  set  a  warranty  price. ^  Many  military  applica¬ 
tions  of  electronics  meet  these  conditions.  But,  where  these  condi¬ 
tions  are  not  fulfilled  and  the  risk  is  unpredictable,  either  the 
warrantor  mu^t  charge  an  inordinate  risk  premium  (as  in  earthquake 
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casualty  insurance)  or  the  Government  may  consider  agreeing  to  absorb 
unpredictable  peak  losses  that  are  in  excess  of  those  the  warrantor  can 
afford. 

In  applying  warranties ,  it  is  important  to  avoid  the  errors  in  past 
efforts  to  transfer  risk  from  the  Government  to  the  contractor.  We  re¬ 
call  the  total-package  procurement  approach  under  which  the  contractor 
was  supposed  to  guarantee  the  sum  of  the  development  and  production  costs 
of  a  weapon  system  on  the  basis  of  a  paper  competition  in  the  concep¬ 
tual  stage,  before  all  the  relevant  technologies  were  adequately  devel¬ 
oped  and  before  any  prototypes  had  been  built.  The  problem  was  that  in 
a  major  system  this  transferred  too  much  risk.  If  the  risk  involved 
was  bigger  than  the  net  worth  of  the  vendor,  it  did  not  really  matter 
that  the  vendor  signed  a  binding  contract;  his  failure  to  meet  his  con¬ 
tract  obligations  could  only  lead  to  his  bankruptcy.  But,  for  political 
reasons  and  to  preserve  its  industrial  base,  the  Government  has  felt 
that  it  could  not  afford  to  force  large  vendors  into  bankruptcy.  Thus, 

the  idea  of  transferring  an  unlimited  risk  from  the  Government  to  the 

2 

vendor  has  been  proven  to  be  unwise  for  large  contracts. 

In  the  warranty  of  new  military  systems,  the  problems  faced  by  the 
Government  bear  considerable  similarity  to  the  problems  of  the  venture 
capitalist,  who  must  decide  how  to  motivate  the  entrepreneur  whom  he  is 
planning  to  back  financially.  Here,  too,  the  risk  is  great  and  the  net 
worth  of  the  entrepreneur  is  too  small  to  provide  a  meaningful  warranty. 
The  venture  capitalist  will  then  invariably  require  that  the  entrepre¬ 
neur  invest  a  substantial  share  of  his  own  net  worth  in  the  venture. 

While  this  does  not  provide  any  substantial  financial  security  for  the 
venture  capitalist’s  investment,  it  does  strongly  motivate  the  entre¬ 
preneur  to  do  his  best  for  the  success  of  the  venture. 

A  similar  approach  may  be  taken  toward  warranties  for  new  military 
systems.  The  bidder  could  be  required  to  furnish  a  long-term  contrac¬ 
tor  maintenance  warranty  (CMW) ,  the  bidder’s  liability  for  a  loss  being 
limited  to  a  negotiated  amount,  possibly  a  significant  fraction  of  the 
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bidder’s  net  worth.*  The  proof  that  a  loss  has  actually  exceeded  such  a 
limit  would  be  the  responsibility  of  the  contractor.  Such  an  approach 
would 

Provide  contractor  maintenance  under  the  warranty  in  most  cases. 

Provide  the  contractor  with  strong  motivation  to  design  the  equip¬ 
ment  well  to  minimize  its  maintenance. 

-  Keep  the  warranty  cost  from  going  sky-high,  since  the  downside 
risk  would  be  limited . 

The  basic  ingredient  of  the  above  approach  is  to  transfer  a  large 
but  not  unlimited  risk  to  the  contractor.  This  can  serve  to  motivate 
the  contractor  strongly,  but  it  would  keep  the  price  of  the  "insurance- 
premium"  component  of  the  CMW  from  becoming  too  large. 

While  a  final  resolution  of  the  problems  entailed  in  pricing  a  war¬ 
ranty  on  contractor  maintenance  of  military  hardware  must  await  further 
experience,  some  recent  developments  in  mathematical  models  of  logistics 
provide  a  reasonable  basis  for  initial  pricing  experiments.  The  Army’s 
Generalized  Electronics  Maintenance  Model  (GEMM)  and  the  AFLC  model  have 
recently  been  applied  to  the  determination  of  life-cycle  maintenance  cost 
as  a  function  of  a  number  of  parameters  such  as  MTBF.  Thus,  MTBF  values 
obtained  by  a  vendor  at  demonstration  tests  could  be  fed  into  the  GEMM 
model  to  provide  estimates  of  warranty  costs^  (Table  IV-1). 

Since  in  practice  the  field  MTBF  does  not  usually  attain  the  value 
attained  in  demonstration  tests,  the  MTBF  used  in  such  calculations  could 
be  multiplied  by  a  number  somewhat  larger  than  the  factor 

H  -  average  (field  MTBF/test  MTBF), 

where  H  represents  the  total  past  experience  with  the  class  of  systems 
under  consideration.  Initially,  of  course,  some  special  efforts  would 
have  to  be  made  to  assemble  the  necessary  base  to  calculate  H. 

*Such  an  approach  may  require  some  modifications  of  the  ASPRs,  since  it 
imposes  different  dollar  limits  on  the  risks  undertaken  by  different 
bidders  on  the  same  RFP. 
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Sensitivity  calculations  using  GEMM  could  provide  a  basis  for  estimating 
the  risk  entailed  in  a  given  warranty  price,  and  they  could  provide  a 
guideline  for  the  negotiators,  allowing  them  to  nudge  the  warranted  MTBF 
upward.  This  would,  of  course,  require  an  estimate  of  the  standard  devia 
tion  of  H,  based  upon  past  experience  with  the  class  of  systems  under  con 
sideration. 

TABLE  IV- 1.  SENSITIVITY  OF  THE  LIFE-CYCLE  SUPPORT  COSTS  OF 
RADAR  SET  AN/PPS-15  TO  CHANGES  IN  MTBF 


Dort  Element 


MTBF  -  3,940  hr 


MTBF  =  1,970  hr 


Test  Equipment 
Publications 
Parts  Stockage 
Float  (Component) 

Inventory 

Training 

Jfanpower  (Maintenance) 
Transportation 

Total  Life-Cycle  Support 
Cost  (LCSC) 

Operational  Availability  (Aq) 
Cost-Effectiveness  (Ao/LCSC) 


$  6,882 

$  13,560 

27,600 

27,600 

1,334,466 

2,613,027 

228,310 

228,310 

179,040 

181,783 

4,524 

8,914 

270,790 

533,511 

89,728 

141,962 

$2,141,340 

$3,748,667 

91.7%  85.0% 

42.83  22.72 


The  proposed  use  of  CMWs  recognizes  that  most  past  DOD  experience 
with  warranties  has  not  been  extremely  encouraging.  The  warranties  most 
often  used  have  been  standard  1-year  guarantees  on  parts,  materials,  and 
workmanship.  In  these  the  DOD  has  faced  problems  in  administration, 
usage,  coming  to  agreement  with  contractors,  and  ascertaining  the  actual 
warranty  costs.  This  history  will  be  described  in  further  detail  later 
in  this  section.  The  CMW  being  recommended  here  for  experimental  imple¬ 
mentation  has  a  long-term  effectiveness,  extending  over  several  MTBF 
periods  of  the  warranted  equipment.  Experience  to  date  with  the  CMW 
will  also  be  described  later. 
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1.  Description  of  Contractor  Maintenance  Warranty 


For  discussion  here,  a  model  contractor  maintenance  warranty  has 
been  selected  from  the  numerous  possible  variants.  The  features  of 
this  CMW  model  believed  essential  for  its  successful  operation  are  as 
follows : 

-  The  product  would  be  warranted  for  a  certain  number  of  operating 
hours  or  a  certain  number  of  years  of  elapsed  time,  whichever 
occurs  first. 

If  the  product  fails  during  the  warranty  period  for  any  reason 
other  than  those  completely  beyond  the  control  of  the  contractor, 
the  contractor  would  repair  or  replace  the  failed  unit  at  no 
additional  cost  to  the  Government. 

-  To  control  the  time  the  contractor  takes  to  repair  failed  units, 
the  nominal  repair-cycle  time  would  be  defined  in  the  contract. 

An  incentive  might  then  be  provided  if  the  contractor  consistently 
performs  the  repairs  in  less  than  the  nominal  time,  and  a  penalty 
might  be  assessed  if  he  consistently  takes  longer. 

-  Since  one  of  the  prime  reasons  for  the  CMW  is  to  provide  the  con¬ 
tractor  with  a  positive  incentive  to  continuously  improve  the 
field  reliability  of  his  product,  he  would  be  given  a  relatively 
free  hand  to  make  "no-cost"  changes  to  improve  reliability  during 
the  life  of  the  warranty.  The  traditional  requirements  for  con¬ 
figuration-change  approval  would  be  modified  as  discussed  in 
Section  IV-D,  on  design  evolution  and  configuration  management. 

The  length  of  the  warranty  would  be  designed  to  encompass  several 
MTBF  periods  on  the  average.  This  would  be  done  to  provide  suffi¬ 
cient  data  for  making  design  changes  that  would  indeed  improve 
field  reliability.  The  longer  period  would  also  be  intended  to 
make  it  profitable  for  the  supplier  to  introduce  cost-effective 
reliability  improvements  as  a  means  of  reducing  the  failure  rate 
and,  therefore,  reducing  his  overall  repair  costs  under  the  war¬ 
ranty. 
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-  The  warranty  agreement  would  be  a  firm  fixed-price  arrangement. 

It  is  believed  that  other  terms  would  tend  to  dilute  the  strong 
incentive/penalty  feature  of  the  warranty. 

-  The  CMW  concept  would  be  introduced  as  part  of  the  DDT&E  package. 
This  would  make  the  warranty  incentive  active  during  the  design 
phase  to  help  produce  the  most  reliable  design  configuration  pos¬ 
sible.  However,  care  must  be  taken  to  avoid  the  problems  of  total- 
package  procurement.  The  price  of  the  warranty  would  be  set  at  the 
time  the  production  contract  is  let  and  would  be  based  either  on 
historical  data,  where  they  are  available,  or  on  MTBF  data  gathered 
during  the  OT&E  phase. 

-  For  long-term  warranties,  an  annual  renewal- at- Government-option 
plan  with  incremental  funding  might  be  used  to  provide  warranty 
funds  to  the  contractor  for  succeeding  periods  after  the  first 
year.  Such  a  plan  would  be  intended  to  eliminate  the  need  fcr 

a  large  cash  expenditure  at  the  beginning  of  the  program  and  to 
permit  the  continuing  annual  warranty  expense  to  be  paid  for  by 
OSM  funds  rather  than  production  funds.  To  encourage  the  con¬ 
tractor  to  invest  in  reliability  improvements,  arrangements  could 
be  made  for  him  to  recover  reliability- improvement  costs  if  the 
Government  did  not  continue  the  warranty  for  a  previously  speci¬ 
fied  number  of  years. 

Prior  experience  (to  be  discussed)  shows  a  number  of  steps  that  would 
have  to  be  taken  during  the  design  phase.  These  are  considered  to  be  an 
essential  part  of  the  warranty  model  being  described.  To  lessen  disagree¬ 
ment  about  responsibility,  it  is  important  that  there  be  no  question  of  un¬ 
authorized  repairs  or  tampering  witnin  the  device.  Access  covers  would  be 
sealed;  breakage  of  the  seals  would  constitute  a  breach  of  the  warranty. 
Effective  warranty  implementation  would  also  be  enhanced  by  an  effective 
built-in  go/no-go  test  coupled  with  an  externally  viewed,  latching  failure 
indicator.*  The  built-in  test  circuit  may,  of  course,  be  prohibitively 

expensive,  but  latching  fault  indicators  that  are  small,  require  little 

H - 

Once  it  is  tripped  by  a  momentary  failure,  a  latching  failure  indicator 
stays  tripped  even  if  the  failure  is  intermittent  or  self -correcting. 
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power,  and  are  compatible  with  a  wide  range  of  electronic  equipment  are 
available  for  about  $31  each  in  quantities  of  1000.  Built-in  time  indi¬ 
cators  would  also  facilitate  warranty  administration.  These,  too,  are 
inexpensive,  costing  $8-$15  in  large  quantities.  To  ensure  appropriate 
handling  of  warranted  units  by  field  personnel,  each  device  would  bear  a 
prominently  located  decal,  warning  against  tampering  and  unauthorized  re¬ 
pair  and  containing  packing  and  shipping  instructions  along  with  basic 
warranty  information  such  as  the  date  of  acceptance  and  the  number  of 
hours  warranted.  It  may  sometimes  be  desirable,  particularly  for  complex 
systems,  to  specify  in  the  warranty  the  operating  hours  and/or  elapsed 
time  for  each  individual  LRU.  Such  an  arrangement  could  help  guarantee 
proper  spare  levels.  Troubleshooting  and  warranty  administration  would  be 
simplified  if  the  system  were  organized  so  that  each  functional  group  of 
circuitry  is,  insofar  as  possible,  complete  in  one  box  and  not  spread 
among  several  boxes.  This  argues  for  planning  for  the  warranty  from  the 
inception  of  the  design  phase. 

2.  Anticipated  Benefits  of  Contractor  Maintenance  Warranties 

Widespread  use  of  CMWs  would  be  expected  to  provide  the  benefits 
listed  below: 

-  Equipment  warranty  would  be  expected  to  internalize  to  the  sup¬ 
plier  the  maintenance  portion,  as  well  as  the  production  portion, 
of  the  life-cycle  cost.  Hence,  it  would  be  expected  to  motivate 
the  supplier  to  minimize  life-cycle  cost  rather  than  production 
cost  in  order  to  increase  overall  profits.  It  would  also  be  ex¬ 
pected  to  provide  a  better  fix  on  life-cycle  cost,  which  would 
now  be  largely  encompassed  in  the  contract  structure.  This  would 
make  competition  based  on  life-cycle  cost  more  feasible. 

Because  of  the  transfer  of  major  maintenance  responsibility  to  the 
supplier,  warranty  should  reduce  the  need  for  detailed  specifica¬ 
tions  on  equipment  design  and  construction  (but  not  the  need  for 
perforrrance  specifications)  and  should  reduce  the  corresponding 
need  for  inspection  and  test  for  compliance  with  detailed  specifi¬ 
cations. 
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-  Equipment  returns  for  repair  under  warranty  would  rapidly  feed 
back  to  the  supplier  knowledge  of  deficiencies  in  the  design, 
fabrication,  and  components  of  the  equipment--knowledge  the  sup¬ 
plier  currently  has  difficulty  in  acquiring  because  of  the  slug¬ 
gish  and  nonlinear  transfer  function  of  the  reporting  systems 

of  the  Services. 

-  Supplier  warranty  should  motivate  the  supplier/warrantor  to  reduce 
returns  of  defective  equipment  by  making  modifications  during  the 
equipment  lifetime  to  improve  reliability. 

-  The  rigorous  configuration  control  needed  to  facilitate  mainte¬ 
nance  of  equipment  by  the  Services  could  be  relaxed  if  a  supplier/ 
warrantor  were  free  to  make  changes  in  the  internal  design  of 
equipment  (at  no  cost  to  the  Government  and  without  its  prior 
approval)  to  improve  reliability  or  to  take  advantage  of  techno¬ 
logical  advances.  Freedom  from  constraints  on  internal  configura¬ 
tion  should  permit  procurement  of  differing  but  interchangeable 
designs  from  more  than  one  supplier/warrantor,  provided  that 
interface  standards  and  environmental  specifications  are  met,  en¬ 
suring  interchangeability. 

-  Through  reliability  improvements  effected  by  the  warrantor,  and 
possibly  through  quicker  repair  turnaround,  warranty  would  poten¬ 
tially  increase  the  availability  of  equipment  in  the  field. 

-  Warranty  should  reduce  the  cost  and  complexity  of  spare- pieces/ 
parts  stocking,  special  and  general  test  equipment,  and  mainte¬ 
nance  documentation. 

-  Warranty  should  reduce  the  overall  cost  of  maintenance  by  making 
use  of  a  more  knowledgeable  and  stable  work  force  than  are  mili¬ 
tary  personnel,  and  by  the  introduction  of  competition  into  the 
maintenance  arena. 

Experience  has  been  too  meager  so  far  to  permit  quantitative  assess¬ 
ment  of  the  value  of  these  benefits;  rather,  it  argues  for  experimental 

4 

implementation  wherever  possible  (this  has  already  been  undertaken  )  and 
suggests  the  data  and  observations  that  should  be  sought  in  such  trials. 

255 


3.  Warranty  Experience 

An  examination  of  warranty  experience  by  the  DOD  and  civilian  organ¬ 
izations  using  equipment  comparable  to  that  used  by  the  DOD  was  undertaken 
as  part  of  this  study.  That  experience  is  described  below,  in  the  context 
of  the  kind  of  warranty  heretofore  extant  and  the  kind  being  proposed  for 
trial.  In  an  attempt  to  quantify  the  cost  of  warranties,  commercial  ex¬ 
perience  is  examined. 

a.  One-Year  Parts,  Materials,  and  Workmanship  Guarantees.  A  large 
quantity  of  minor  electronic  and  electrical  equipment  has  been  covered  by 
1-year  "failure- free”  warranties  (FFWs).  However,  the  imposed  conditions 
of  the  warranties  have  usually  been  limited  to  guarantee  of  workmanship 
and  material.  During  1970  and  1971  the  Defense  Electronics  Supply  Agency 
included  this  kind  of  warranty  in  all  its  procurement. 

Military  experience  with  such  warranties  for  major,  high-cost  elec¬ 
tronic  equipment  has  been  limited  so  far.  During  a  20-month  period,  only 

25  contracts  representing  5  percent  of  the  total  procurement  expenditures 

5  6 

of  AECOM  were  under  warranty.  ’  Similar  situations  have  existed  in  both 
Navy  and  Air  Force  procurements.  The  paucity  of  warranty  coverage  was 
found  to  be  a  result  of  the  problems  encountered  by  the  military  in  pre¬ 
vious  warranties.  These  problems  centered  on  product  quality,  warranty 
administration,  warranty  cost,  and  equipment  turnaround  time.  Neither  the 
Services  nor  the  GAO  has  been  able  to  confirm  that  the  warranties  used 

motivated  the  contractors  to  improve  product  quality  or  performance.  In- 

5  6  7 

vestigations  by  both  the  GAO  ’  and  DCAS  nave  shown  that  faulty  adminis¬ 
tration  of  warranties  by  the  Government  resulted  in  improper  failure 
validation,  incomplete  warranty  identification,  improper  handling  of  war¬ 
ranted  items,  poor  depot  material  control,  and  a  general  lack  of  manage- 

g 

ment  of  or  responsibility  for  warranted  items.  A  recent  study  by  AFLC, 
containing  a  depot  survey,  indicated  that  only  22  percent  of  the  war¬ 
ranted  items  at  the  depot  were  properly  identified.  The  GAO  surveyed 
the  Air  Materiel  Area  at  Ogden  in  early  1973  and  reported  that  only  51 
percent  of  the  warranted  items  were  properly  identified,  and  that  58 
percent  of  these  had  passed  the  warranty  expiration  dates  without  repair. 
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The  GAO  also  reported  that  many  defective  warranted  items  were  repaired 
by  field  personnel  or  discarded  without  return. 

b.  Contractor  Maintenance  Warranties.  The  use  of  warranties  cover¬ 
ing  more  than  one  year  and  based  on  maintenance  by  the  contractor  has  been 
extremely  limited.  In  fact,  only  five  meaningful  examples  were  discovered 
during  the  Electronics-X  Study.  One  of  these  five  was  an  abortive  attempt 
that  did  not  materialise  because  of  objections  by  the  contractual  and 
legal  community  within  NAVAIR.  These  examples  are  discussed  in  the  subse¬ 
quent  text,  along  with  two  examples  of  the  use  of  warranties  by  the  com¬ 
mercial  airlines. 

(1)  CN-494A/2171P  Two-Gyro  Platform.  In  late  1967,  Lear 

Siegler,  Inc.,  entered  into  an  agreement  with  the  Aviation  Supply  Office 
of  the  Navy  for  the  refurbishment  of  800  CN-494A/2171P  gyros.  The  refur¬ 
bished  gyros  were  delivered  with  a  1500-hour  or  5-year  warranty. 

These  800  gyros  were  selected  from  a  total  population  of  about  2500 
CN-494A/2171P  units.  The  remaining  1700  gyros  continued  to  be  repaired  by 
a  combination  of  in-house  maintenance  and  contract  maintenance  on  a  time- 
and-materials  basis. 

The  MTBF  of  the  total  population  of  gyros  at  the  beginning  of  this 
program  (1967)  was  400  hours.  Since  some  of  these  gyros  had  been  main¬ 
tained  by  Lear  Siegler  on  a  commercial  "time-and-materials"  repair  arrange¬ 
ment,  the  cost  of  an  average  repair  was  well  known.  The  cost  of  the  1500- 
hour  warranty  was  then  based  on  this  average  experienced  repair  cost 
multiplied  by  a  factor  of  3.3,  a  factor  that  anticipated  an  improvement  in 
MTBF  to  454  hours  as  a  rQ^ult  of  the  warranty.  The  existing  MTBF  of  400 
hours  would,  of  course,  have  resulted  in  a  factor  of  3.75  rather  than  the 
lower  number  of  3.3.  Thus,  under  these  terms,  the  warranty  cost  was  12 
percent  less  than  the  Navy  had  been  paying  to  get  these  repairs  done  by 
Lear  Siegler*  under  the  previous  arrangement,  and  an  immediate  saving  was 
realized. 


It  is  the  belief  of  Markowitz  at  ASO  that  in  1967  the  repair  costs 
under  the  contractor  maintenance  arrangement  at  Lear  Siegler  (without 
FFW)  were  no  higher  than  those  at  the  Navy  repair  dnn.^ 
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After  nearly  5  years  of  experience,  the  actual  MTBF  of  the  800  units 
under  warranty  had  risen  to  523  hours  by  April  1972.  This  represents  an 
increase  in  MTBF  of  31  percent  during  the  warranty  period. 

Unaer  the  terms  of  this  contract,  the  Navy  realized  an  initial  saving 
of  12  percent  in  repair  costs  over  the  5-year  period  and,  in  addition,  got 
a  bonus  of  a  31  percent  increase  in  reliability  with  a  corresponding  in¬ 
crease  in  aircraft  availability.  Needless  to  say,  both  the  Navy  and  Lear 
Siegler  are  well  pleased  with  the  results  of  this  arrangement  and  have 
just  rejently  concluded  an  agreement  to  extend  the  warranty  for  another 
5-year  period  at  a  lower  price. 

The  reader  will  ubserve  that  the  terms  of  this  warranty  provided  for 
an  anticipated  average  of  3.3  failures  per  unit  during  the  1500  operating 
hours.  The  object  of  this  was  to  provide  the  information  and  incentive  to 
the  contractor  to  encourage  continued  reliability  improvement  during  the 
life  of  the  contract.  In  actual  fact,  the  contractor  did  indeed  make  im¬ 
portant  design  changes  to  lower  his  overall  costs  during  the  warranty 
period.  These  changes  were  of  equal  benefit  to  the  Navy  in  terms  of  in¬ 
creased  reliability  and  availability. 

(2)  AF24G-27  Gyro  for  Air  Force  F-lll--Lear  Siegler  and  USAF/ 

g 

ASP.  This  warranty  contract  resulted  from  a  competition  between  Lear 
Siegler  and  General  Electric,  General  Electric  being  the  original  sup¬ 
plier  and  designer  of  the  device.  The  contract  was  let  in  late  1969  and 
provided  for  the  procurement  of  128  gyros  with  a  warranty  calling  for 
3000  hours  of  operation  or  5  years,  whichever  came  first. 

The  warranty  price  was  based  on  an  anticipated  MTBF  of  1494  hours  and 
an  average  of  two  returns  for  repair  during  the  warranty  period.  The  field 
MFHBF  for  the  previous  supplier's  gyro  for  a  24- month  period  in  1970-1971 
was  426  hours.  If  one  uses  an  operating- to-f light-hour  figure  of  1.63 
(from  Navy  data  on  F-4  and  A-4  gyros),  this  very  roughly  translates  into 
an  MTBF  of  690  hours,  as  compared  to  the  1494  hours  under  warranty. 

The  unit  price  of  the  warranted  gyro  was  $6040,  with  the -5-year  war¬ 
ranty  priced  at  an  additional  $2200.  This  translates  into  an  annual  war¬ 
ranty  cost  of  7.3  percent  of  the  gyro  procurement  cost. 


Answers  to  many  of  the  questions  raised  by  this  contract  are  not 
available.  Lear  Siegler  is  preparing  a  report  on  an  "Annual  Warranty 
Effectiveness  Study,"  which  is  expected  to  be  available  soon.  Answers  to 
questions  such  as  those  listed  below  are  anticipated  from  this  report: 

-  How  does  the  annual  repair  cost  of  $440  per  gyro  under  the  Lear 
Siegler  warranty  compare  with  the  current  repair  costs  of  the  un¬ 
warranted  General  Electric  gyros? 

-  How  does  the  actual  field  reliability  of  the  Lear  Siegler  gyro 
compare  with  the  earlier  unwarranted  General  Electric  units? 

Lear  Siegler  has  taken  some  positive  measures  that  should  improve  the 
reliability  and  maintainability  of  the  gyro  as  a  result  of  the  warranty 
pressures. 

The  ground  rules  of  this  procurement  permitted  the  contractor  con¬ 
siderable  freedom  to  make  changes  within  the  device  as  long  as  the  form, 
fit,  and  function  of  the  complete  device  were  unchanged.  As  a  result, 

Lear  Siegler  made  sweeping  design  changes  within  the  unit  in  an  attempt  to 
improve  reliability  and  maintainability.  For  example,  James  Harty  of  Lear 
Siegler  states  that  the  former  design  required  150  operations  to  remove  a 
gyro  wheel.  By  careful  redesign,  he  states,  this  has  been  reduced  to  12 
operations. 

As  a  result  of  analyzing  field  failure  modes,  changes  have  been  made 
to  improve  the  field  reliability  and  thus  reduce  the  rate  of  returns  to 
Lear  Siegler.  One  such  change,  cited  by  Colonel  Lawrence  C.  Wrr.yht  o£  asd, 
involved  modifications  to  gyros  in  production  and  r»p<air  to  correct  a 
drift  problem  experienced  in  the  field. 

A  minor  problem  has  developed  involving  gyros  which  were  returned  for 
repair  but  which  tested  "good"  on  receipt  at  Lear  Sieglei .  This  does  not 
appear  to  be  cataclysmic,  however,  since  the  rate  of  "good"  tests  to  date 
is  12  percent  (or  four  gyros). 

Another  area  amenable  to  some  corrective  effort  is  the  time  consumed 
for  repairs  at  Lear  Siegler.  Contractually ,  this  was  set  at  45  days;  how¬ 
ever,  the  average  time  to  date  has  been  92  days.  This  has  been  improving 


recently,  the  average  for  a  recent  6-month  period  being  73  days.  This 
time  is  measured  from  receipt  on  the  Lear  Siegler  dock  to  shipment  of  the 
repaired  gyro  from  Lear  Siegler. 

(3)  APN-194  Electronic  Altimeter. ^  Honeywell  is  the  supplier 
of  the  APN-194  altimeter.  The  APN-194  is  a  redesign  of  an  existing  elec¬ 
tronic  altimeter  in  which  the  bulk  of  the  change  consists  of  replacing 
older  technology  with  integrated  circuitry.  There  was  no  requirement  for 
any  major  performance  improvements.  The  selling  price  is  about  $5000  per 
unit. 

Since  this  is  a  quite  recent  contract,  there  is  no  real  information 
available  at  this  time  on  the  effects  of  the  warranty  on  field  performance. 

The  annual  cost  of  the  warranty  was  about  7  percent  of  the  unit  sell¬ 
ing  price  of  the  APN-194,  according  to  0.  E.  Hall  of  NAVAIR. 

The  warranty  provides  for  Honeywell  to  make  all  repairs  (with  the 
usual  exceptions)  to  any  unit  which  fails  during  the  first  1500  hours  of 
operation  or  the  first  2  years,  whichever  comes  first.  The  contract  fur¬ 
ther  provides  for  a  45-day  turnaround  at  Honeywell,  with  a  penalty  of  one- 
half  of  1  percent  of  the  unit  selling  price  for  each  day  this  is  exceeded, 
up  to  a  maximum  of  25  percent  of  the  unit  cost. 

(4)  OMEGA  Receiver--NAVAIR  Procurement  from  Northrop.'1'1'1  This 
warranty  procurement  is  also  very  recent  (early  1973)  ,  so  no  feedback  on 
the  performance  and  benelits  actually  accrued  under  the  warranty  are 
available . 

The  OMEGA  receiver  procurement,  for  use  in  the  Navy  P-3C  aircraft, 
provided  that  Northrop  would  repair,  at  no  additional  cost,  any  receiver 
that  failed  within  an  initial  2-year  period.  In  this  case,  there  was  no 
limit  on  the  operating  hours  that  could  be  amassed  during  the  2-year 
elapsed  time. 

Under  the  contract,  25  percent  additional  OMEGA  receivers  were  pro¬ 
vided  as  spares  for  replacement  of  receivers  in  the  repair  pipeline. 

The  complexity  of  the  OMEGA  receiver  can  be  judged  by  its  unit  sell¬ 
ing  price,  which  is  approximately  $18,000. 
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(5)  SBK- 11A/A24G-26  Attitude  Gyro.  There  was  an  attempt  to 
introduce  a  requirement  for  a  warranty  of  4000  hours  or  8  years  in  a 
recent  competitive  procurement  for  the  SBK-11A/A24G- 26  gyro,  involving 
General  Electric  and  Lear  Siegler  as  the  competitors.  In  this  case,  the 
8- year  warranty  cost  would  have  amounted  to  about  50  percent  of  the 
contract  price. 

The  contractual  and  legal  community  in  NAVAIR  objected  to  this 
arrangement  on  the  following  grounds: 

-  The  arrangement  would  have  used  large  amounts  of  production  funds 
for  naintenance  activities  that  would  otherwise  have  been  properly 
funded  on  an  annual  basis  from  O&M  funds. 

-  The  arrangement  would  have  constituted  an  insurance  policy,  and 
the  Government  does  not  buy  insurance  but  relies  on  self-insurance 
instead. 

In  this  case,  the  objections  were  sustained  (the  long  warranty  period 
had  a  great  influence  on  this  decision),  and  the  requirement  for  war¬ 
ranty  was  deleted  from  the  procurement. 

(6)  RPR- IF  Bendix  Airline  Weather  Radar.  This  radar  is  sup¬ 
plied  to  the  commercial  airlines  with  a  1000-hour  or  1-year  warranty  in¬ 
cluded  as  part  of  the  purchase  price.  Although  Bendix  would  not  divulge 
the  percentage  of  the  selling  price  involved  in  the  warranty,  the  cost 
cannot  be  excessive  since  the  entire  system  sells  for  only  $23,000,  a 
very  low  figure  when  compared  to  the  price  of  a  similar  weather  radar 
built  to  military  specifications. 

This  warranty  is  generally  serviced  by  the  airline  customer  in  the 
airline  avionics  shop.  The  airline  then  bills  Bendix  for  any  repair  costs 
during  the  warranty  period. 

When  the  RDR-1F  was  first  introduced  into  service  with  American  Air¬ 
lines  3  or  4  years  ago,  the  radar  exhibited  an  air  time  between  failures 
(ATBF)  of  350  hours  for  the  first  3  months.  As  a  result  of  close  coopera¬ 
tion  between  American  Airlines  and  Bendix,  this  number  had  risen  to  an 
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average  of  .1400  hours  during  the  eighth,  ninth,  and  tenth  months  of  serv¬ 
ice,  and  it  averaged  2450  hours  for  the  year  1972,  according  to  AA  records. 

This  improvement  in  reliability  is  certainly  due  in  large  measure  to 
modifications  introduced  into  the  radar  as  a  result  of  the  warranty  pro¬ 
gram. 

It  is  also  worthy  of  note  that  the  RDR-1F  has  a  built-in  test  capa¬ 
bility  coupled  with  a  failure- warning  annunciator. 

(7)  CAROUSEL  IV  Inertial  Navigation  System. ^  This  system, 
which  is  nanufactured  by  the  General  Motors  Delco  Electronics  Division,  is 
another  example  of  reliability  improvement  under  warranty. 

The  CAROUSEL  IV  is  delivered  with  a  1-year  warranty  (regardless  of 
operating  hours).  It  is  further  warranted  to  have  an  MTBF  of  1300  hours. 

The  CAROUSEL  IV  is  installed  on  nearly  all  commercial  747s,  and  these 
aircraft  average  8.9  flight  hours  per  day  (wheels  up  to  wheels  down).  Be¬ 
cause  the  inertial  navigation  system  (INS)  is  turned  on  before  takeoff  and 
is  turned  off  after  landing,  and  also  because  of  ground  alignment  time, 
the  recorded  INS  operating  time  is  about  1.4  times  the  recorded  flight 
hours.  Thus,  the  total  expected  operating  hours  during  the  1-year  war¬ 
ranty  period  are 

8.9  x  1.4  x  365  =  4550  hours. 

This  indicates  that,  on  the  average,  the  warranty  period  encompasses  3.5 
MTBFs. 

The  CAROUSEL  IV  warranty  has  a  provision  requiring  General  Motors  to 
provide  additional  spare  units  on  loan  if  the  MTBF  is  less  than  the  war¬ 
ranted  1300  hours.  These  units  can  be  used  by  the  airlines  to  maintain 
aircraft  availability  until  the  1300-hour  MTBF  is  attained,  since  this 
figure  was  used  by  the  airlines  to  establish  their  spares  stocking  level. 

General  Motors  further  guarantees  a  7-day  turnaround  cycle  for  re¬ 
paired  units.  If  this  cycle  time  is  not  met,  General  Motors  must  provide 
a  spare  unit  on  loan  until  the  defective  unit  is  returned. 

Because  of  the  unique  nature  of  the  system,  most  of  the  repairs  under 
the  warranty  are  done  by  General  Motors  rather  than  by  the  airlines.  About 
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half  the  airlines  are  certified  to  do  first- level  repairs.  This  consists 
of  isolating  a  trouble  to  a  printed  circuit  card  and  replacing  the  card 
with  another.  Failed  cards  are  returned  to  General  Motors  for  repair. 
General  Motors  is  billed  for  the  repair  costs  at  the  airline  snop  under 
the  warranty  terms. 

Three  airlines  do  third- level  repair  work,  which  consists  of  repairs 
to  failed  cards.  Only  one  airline  has  attempted  second-level  repairs, 
which  consist  of  the  repair  of  failed  electromechanical  subassemblies.  In 
no  case  has  an  airline  attempted  the  repair  of  gyros  or  accelerometers. 

When  the  CAROUSEL  IV  was  first  introduced  in  1971,  the  MTBF  was  be¬ 
tween  400  and  500  hours.  As  a  result  of  the  warranty  pressures,  General 
Motors  made  extensile  changes  within  the  system,  and  the  MTBF  is  currently 
in  excess  of  the  1300  hours  warranted.  These  modifications  were  accom¬ 
plished  at  considerable  expense  to  General  Motors. 

To  prevent  "infant  mortality,"  each  system  receives  an  extensive 
burn-in  at  the  factory  before  delivery  to  the  airlines. 

After  the  first  year  of  warranty,  maintenance  is  handled  either  by  an 
extension  of  the  warranty  at  a  cost  of  $9000  per  installed  system  (spares 
are  not  charged  for)  per  year  or  by  factory  repair  on  a  case-by-case  basis. 
Under  the  latter  arrangement,  the  airline  is  charged  a  price  listed  in  a 
standard-ropair-cost  catalog  for  each  repair  action. 

The  CAROUSEL  IV  has  also  been  sold  to  the  Air  Force  for  use  in  the 

12 

Airborne  Command  Post  aircraft  (EC-135J).  In  this  case,  a  warranty 
similar  to  that  furnished  the  airlines  was  provided.  General  Motors 
agreed  to  do  all  maintenance  on  the  system  for  a  period  of  1  year  at  a 
cost  equivalent  to  8.3  percent  of  the  system’s  selling  price  of  approxi¬ 
mately  $100,000.  They  further  warranted  an  MTBF  of  1100  hours  to  be 
measured  in  the  first  6  months  of  actual  service  in  the  aircraft.  When 
the  6-month  test  period  ended  on  31  March  1972,  the  systems  had  demon¬ 
strated  an  MTBF  of  2208  hours,  over  twice  the  reliability  warranted. 
General  Motors  had  agreed  to  furnish  additional  spares  at  one-half  price 
if  the  MTBF  warranty  was  not  met. 
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4.  Cost  of  Warranties 


a.  In-House  Maintenance  Versus  Warranty  Maintenance.  An  effort  was 
made  to  compare  the  costs  of  in-house  maintenance  and  warranty  maintenance. 
Since  comparable  cost  data  on  the  two  methods  of  maintenance  could  not  be 
obtained  from  within  the  military  Services,*  a  family  of  equipment  was 
sought  that  the  military  and  the  commercial  airlines  both  use  extensively, 
and  that  is  maintained  without  warranty  by  the  military  and  under  warranty 
by  the  airlines.  Inertial  navigation  systems  meet  these  criteria,  and, 
since  cost  data  on  their  maintenance  were  readily  available  from  the  mili¬ 
tary  and  the  airlines,  these  data  were  used  for  comparison  of  in-house  and 
warranty  maintenance  costs. 

The  data  in  Table  IV-2  show  that  the  annual  maintenance  cost  of  the 
two  inertial  navigation  systems  at  Air  Force  depots  ranges  from  12.9  per¬ 
cent  to  17.6  percent  of  the  initial  unit  prices  of  the  systems,  while  the 
cost  of  similar  maintenance  for  the  airlines  under  contractor  warranty 
varies  from  7.4  percent  to  9.0  percent.  On  the  average,  then,  for  these 
systems  the  direct  cost  of  Air  Force  depc >  maintenance  is  1.8  times  the 
total  cost  ?o  the  airlines  for  equivalent,  maintenance  under  contractor 
warranty.  Moreover,  it  should  be  noted  tnat  the  warranty  costs  are  the 
total  costs  for  the  equivalent  of  depot  maintenance,  whereas  the  costs 
shown  for  Air  Force  depot  maintenance  are  only  the  direct  costs  and  ex¬ 
clude  indirect  costs. 

While  the  operating  environment  is  more  severe  for  military  aircraft 
than  for  airliners,  average  use  of  airliners  is  up  to  nine  times  greater 
than  use  of  average  military  aircraft,  depending  on  the  type  of  aircraft. 
These  two  factors  should  tend  to  offset  one  another  where  annual  mainte¬ 
nance  costs  are  concerned. 

Of  course,  the  above  data  address  only  the  depot  side  of  the  mainte¬ 
nance  picture.  However,  according  to  Digby,^  depot  repairs  account  for 
83  percent  of  the  maintenance  cost  of  the  inertial  platform  in  the  F-4D/E 


‘•’•'Where  cost  data  were  found  on  military  use  of  warranty  maintenance,  com¬ 
parable  cost  data  on  repairs  by  Service  depots  were  unavailable. 
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TABLE  IV- 2 .  MAINTENANCE  COSTS  OF  INERTIAL  NAVIGATION  SYSTEMS  BY 
MILITARY  DEPOT  AND  BY  CONTRACTOR  WARRANTY  TO  AIRLINES 
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Maintenance  Under  Contractor 

Maintenance  by  Military  Depot  warranty  to  Airlines 


INS  for  A-7D  Aircraft.3 

Consists  of  ASN-90  INS  and,ASN-91  naviga¬ 
tion  computer.  Accuracy  1-2  nmi/hr. 

Unit  Cost  of  System:  $122,000 

Annual  Depot  Direct  ftein- 

tenance  Cost:  $21,540 

Annual  Depot  Direct  ftein- 

tenance  Cost  as  Percentage 

of  System  Unit  Cost:  17.6% 


INS  for  F-4D/E  Aircraft.3 

Consists  of  ASN-63  INS  and  ASN-46A  navi¬ 
gation  computer.  Accuracy  2.5  nmi/hr. 

Unit  Cost  of  System  $90,000 

Annual  Depot  Direct  Main¬ 
tenance  Cost:  $11,580 

Annual  Depot  Direct  Main¬ 
tenance  Cost  as  Percentage 
of  System  Unit  Cost:  12.9% 


CAROUSEL  IV  INS  for  747,  DC- 10,  and  Other 
Aircraft. 

Includes  navigation  computer.  Accuracy 
0.9  nmi/hr.  Used  by  35  airlines.  Sup¬ 
plier/Contractor:  Deleo  Electronics 
Division,  General  Motors  Corporation. 

Unit  Cost  of  System:  $100,000 

Annual  Cost  of  ttaintenance 

Contract:  $9,000 

Annual  Total  Cost  of  Depot 
Maintenance  Under  Warranty  as 
Percentage  of  System  Unit  Cost:  9.0% 


Litton  LTN-51  (Arinc  561)  INS.C 

Includes  navigation  computer.  Accuracy 
1  nmi/hr. 

Unit  Cost  of  System:  $107,000 

Annual  Cost  of  Litton  ftein¬ 
tenance  Contract:  $9,000 

Annual  Total  Cost  of  Depot 
Maintenance  Under  Warranty  as 
Percentage  of  System  Unit  Cost:  8.4% 


Collins  INS-61B  for  DC-8-63F  Aircraft. d 

Includes  navigation  computer.  Accuracy 
2  nmi/hr. 

Unit  Cost  of  System:  $88,000 

Annual  Cost  of  Collins  ftein¬ 
tenance  Contract:  $6,500 

Annual  Total  Cost  of  Depot 
Maintenance  Under  Warranty  as 
Percentage  of  System  Unit  Cost:  7.4% 


-  id 

source: 

Ref. 

14. 

bData 

source: 

Ref. 

11. 

cData 

source : 

Ref. 

15. 

dData 

source : 

Ref. 

16. 
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and  92  percent  of  the  maintenance  cost  of  the  inertial  platform  in  the 

A-7D.  The  balance  of  the  maintenance  cost  (17  percent  and  8  percert,  ^ 

re'pectively)  is  accounted  for  by  base  maintenance. 

b.  Avionics  Warranty  Costs.  Table  IV-3  gives  the  annual  costs  of  > 

several  warranties  on  avionic  equipment.  The  CAROUSEL  IV  was  also  sold 
to  the  Air  Force  with  a  CMW  for  use  in  the  EC-135J  Airborne  Command  Post 
aircraft.  In  this  case,  the  annual  warranty  cost  was  8.3  percent  of  the 
acquisition  cost  of  $100,000.  Again,  no  charge  was  made  for  spare  systems; 
the  annual  warranty  has  recently  been  renewed  for  the  third  year. 

TABLE  IV-3.  ANNUAL  COSTS  OF  SOME  AVIONICS  WARRANTIES 


Equipment 

Supplier 

Use 

Unit 

Acquisition 

Cost 

Annual  Cost 
of 

Warranty 

Annual  Cost  as 
Percentage  of 
Acquisition 
Cost 

AF  24G-27  Gyro  fot 
Air  Force  F-lll  Air¬ 
craft3 

Lear  Siegler,  Inc. 

Military 

$  6,040 

$  440 

7.  3% 

LTN-51  (Arinc  561) 
INSb 

Licton  Systems, 

Inc. 

Commerc  ial 

107,000 

9,000 

8.4 

CAROUSEL  XV  IMSC 

Delco  Electronics 
Division,  General 
Motors  Corporation 

Commerc  ia  1 

100,000 

9,000 

9.0 

INS-61Bd 

Collins  Radio  Co. 

Comnv 

98,000 

6,500 

7.4 

APN-194  Electronic 
Altimeter 

Honeywell,  Inc. 

Milica 

4,900 

543 

7.0 

aData  source:  Ref. 

1 

^Data  source:  Ref. 

15. 

cData  source:  Ref. 

11. 

This  warranty  charge  m 

•  only  on  installed  systems. 

There  is  no 

warranty  charge  on  spares.  Since  the  airlines  ,  buy  35  percent  spares,  the  annual  cost 

based  on  all  delivered  units,  including  spares,  is  >nly  <-.7  percent  of  acquisition  cost. 

aData  source:  Ref.  16. 


The  above  warranty  costs  are  consistent  with  the  findings  of  Balaban 

18 

and  Retterer,  of  Arinc  Research  Corporation,  who  found  annual  costs  of 
commercial  airline  warranties  to  range  from  4  percent  to  10  percent  of 
unit  purchase  price  with  spares  included  in  the  calculation.  It  should  be 
noted,  however,  that  the  Arinc  findings  are  largely  based  on  informed 
opinion.  There  are  little  hard  data  available  on  the  costs  of  warranties, 
particularly  extended,  reliability-oriented  warranties  like  the  CMW. 

266 


•wwwywyrjwy 


.--• .  -  ptMJKT^^ IWM^tfflS^T'iPf-''  V-  « ^SUPP****?^ 


c.  General  Observations  on  Warranty  Costs.  The  GAO  studied  the  use 
of  warranties--primarily  the  1-year  "failure-free"  warranties  discussed 
earlier--and  could  discover  no  auditable  warranty  costs  from  alL  contract 
warranties  administered  by  the  Navy  Aviation  Supply  Office, J,t'  the  Army 

1<j 

Electronics  Command,  and  the  Air  Force  Ogden  Air  Materiel  Area.  The 
Defense  Contract  Administration  Services^  reported  that  warranty  costs 
were  rarely,  if  ever,  itemized  during  contract  negotiations  and  concluded 
that  the  Government  had  no  accurate  way  to  measure  or  estimate  true  war¬ 
ranty  costs.  A  number  of  contractors  have  indicated  that  they  do  not  ex¬ 
plicitly  price  warranty  service  because  they  do  not  experience  significant 
costs.  This  arises  because  the  equipment  is  not  used  in  the  specified 
environment,  or  the  returned  items  are  either  danaged  by  the  Government, 
damaged  during  shipping,  or  found  to  be  operating  within  specifications. 

To  provide  a  possible  basis  for  assessing  warranty  costs  by  analogy, 
an  attempt  was  made  to  ascertain  warranty  costs  for  commercial  and  con¬ 
sumer  goods. 

The  cost  of  commercial  warranties  was  investigated  by  contacting 
manufacturers  of  commercial  electronic  pioducts  and  several  airline  war¬ 
ranty  organizations.  As  was  found  for  military  equipment,  the  exact  cost 
of  the  standard  warranty  is  seldom,  if  ever,  displayed  separately  in  pro¬ 
curement  documentation.  Warranty  personnel  of  Pan  American  World  Airways 
stated  that  avionics  subcontractors  for  the  Boeing  747  aircraft  quoted  the 
cost  of  a  3-year  "failure-free"  warranty  as  part  of  the  equipment  cost. 
Attempts  to  break  out  the  warranty  cost  during  the  procurement  process 
were  unsuccessful  under  the  price  competition.  Pan  American  estimates 
these  costs  can  amount  to  as  much  as  15  percent  of  the  acquisition  price 
per  year.  It  should  be  noted  that  these  contracts  do  not  cover  any  sched¬ 
uled  maintenance  of  the  equipment. 

Warranty  costs  for  consumer  goods  are  also  proprietary  in  nature  and 
are  contained  in  the  product  purchase  price.  Investigations  in  the  area 
of  radio  and  television  equipment  revealed  that  the  cost  of  the  initial 
contract  warranty  is  a  major  pricing  item  representing  cost  tradeoffs  in 
component  cost,  assembly-line  quality  control,  and  expected  failure  rates. 
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Such  costs  and  the  failure- rate  basis  for  their  calculation  are  tightly 
held,  companv-conf idential  information. 

Although  the  CMW  offers  promise  of  many  benefits,  including  a  long¬ 
term  saving  in  maintenance  cost,  it  does  appear  to  require  an  additional 
initial  outlay  of  funds,  of  uncertain  amount,  to  pay  the  warranty  cost. 

This  is  alleviated  to  some  extent  by  the  annual-option  approach  and  by  the 
offsetting  savings  in  the  cost  of  initial  spare  parts  and  subassemblies, 
maintenance  handbooks,  maintenance  training,  and  depot-  and  intermediate- 
level  test  equipment.  These  expent.es  do  not  have  to  be  Incurred  as  long 
as  the  contractor  is  responsible  for  maintenance,  but  they  may  be  necessary 
later  if  the  Government  is  to  continue  maintenance  after  the  warranty  ex¬ 
pires.  This  will  be  discussed  further  in  Section  IV-A-b-b. 

5 .  Operational  Considerations 

The  following  discussion  is  based  on  the  limited  military  experience 
with  CMWs  to  date  and  on  consideration  of  commercial  (e.g.  ,  airline)  equip¬ 
ment  operated  under  warranty. 

a.  Repair  Locations.  The  best  and  most  economical  location  for  con¬ 
tractor  repairs  under  warranty  will  vary  with  the  type,  quantity,  and  dis¬ 
tribution  of  equipment  under  consideration  and  the  type  of  contractor  in¬ 
volved.  Availability  of  the  equipment  as  well  as  replacement  spare  require¬ 
ments  must  be  considered. 

Generally,  as  shown  in  Part  II,  less  complex  hardware  comprising  only 
a  single  unit  or  several  small  units  will  inherently  have  much  higher  re¬ 
liability  than  the  more  complex  electronic  systems  and  subsystems.  There¬ 
fore,  the  percentage  of  these  devices  in  the  repair  pipeline  at  any  one 
time  could  be  relatively  low,  making  the  spare-replacement-unit  problem 
less  severe.  It  follows  that,  assuming  a  reasonable  spares  level,  the 
availability  of  units  will  not  be  a  major  problem.  Shipping  costs  for 
equipment  of  this  nature  would  also  be  relatively  low.  For  this  type  of 
equipment,  then,  there  will  only  be  an  occasional  need  for  maintenance 
personnel  in  the  field,  and  the  warranty  can  be  serviced  by  returning  the 
boxes  to  the  factory  for  repair. 
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If  the  equipment  is  widely  dispersed  and  the  contractor  has  a  large 
amount  of  this  and  similar  equipment  in  the  field,  it  would  probably  be 
more  desirable  to  have  contractor-operated  repair  centers  at  several  loca¬ 
tions,  as  is  now  done  by  many  manuf acturers  of  electronic  equipment  for 
the  consumer  trade. 

Complex  electronic  systems  and  subsystems  would  no  doubt  frequently 
require  contractor  maintenance  personnel  in  the  field  at  the  intermediate 
level  and  occasionally  at  the  operational  level.  Airborne  fire-control 
radars  are  an  example  of  this  type  of  equipment.  These  radars  have  typi¬ 
cally  been  unreliable  in  the  field  and  have  accounted  for  considerable 
maintenance  effort  in  both  the  Air  Force  and  the  Navy.  Newer  digital  de¬ 
signs  are  predicted  to  have  an  order-of-magnitude  improvement  in  field  re¬ 
liability,  and  perhaps  contractor  warranties  can  help  ensure  that  this 
will  indeed  come  to  pass.  Table  IV- 4  gives  a  reliability  a  re  lysis  by  line 
replaceable  unit  (LRU)  of  a  new-generation  digital  fire-control  radar. 

The  nenufacturer  of  this  radar  anticipates  that  two-thirds  of  the  relia¬ 
bility  predicted-  in  Table  IV-4  (i.e.,  an  MTBF  of  about  100  hours)  will 
actually  be  achievable  in  the  field.  Since  these  systems  generally  are 
operated  about  half  as  much  on  the  ground  as  in  the  air,  the  mean  flight 
hours  between  failures  (MFHBF)  would  then  be  about  67  hours.  This  failure 
rate  would  be  high  enough  to  require  support  by  one  or  more  contractor 
maintenance  men  at  each  location  having  a  concentration  of  aircraft  using 
the  system.  These  maintenance  men  would  have  to  be  supplied  with  suffi¬ 
cient  pieces,  parts,  and  subassemblies  to  permit  them  to  make  many  of  the 
warranty  repairs  on  the  spot,  thus  reducing  the  Services*  inventory  of 
major  spare  assemblies  required,  while  at  the  same  time  maintaining  a  high 
system-availability  level. 

Situations  could  occur  in  which  the  quantity,  complexity,  and  failure 
rate  of  an  electronic  device  are  such  as  to  make  it  desirable  to  have  con¬ 
tractor  repair  personnel  in  the  field,  but  in  which  the  required  repair 
activity  is  not  enough  to  justify  a  full-time  man.  In  this  event,  the 

*Two  prototype  systems  have  been  built  and  are  currently  under  test. 

Reliability  numbers  are  calculated  predictions. 
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possibility  could  be  considered  of  two  or  more  contractors  entering  into 
a  cooperative  arrangement  in  which  one  of  the  contractors  does  the  war¬ 
ranty  servicing  for  himself  and  the  others.  This  could  be  accomplished 
through  a  suitable  subcontract  arrangement. 

TABLE  IV- 4.  FELIABILIIY  PREDICTION  BY  LINE  REPLACEABLE  UNIT, 

TYPICAL  1973  DESIGN,  DIGITAL  AIRBORNE  INTERCEPT  RADAR 


Line  Replaceable  Unit 

Parts  Count 

MTBF3 

Prediction , 
hours 

Antenna 

60 

3,500 

Low- Voltage  Power  Supply 

900 

2,000 

Transmitter 

1,400 

1,400 

Servomechanism 

620 

3,200 

Microwave  Receiver 

410 

2,500 

Waveguide  (Macrowave  Shelf) 

25 

4,500 

Stabilized  Local  Oscillator 

300 

5,800 

Computer 

90 

1,300 

Processor 

300 

300 

System  4,105  160 


aIndividual  MTBF  of  line  replaceable  unit  is  high  enough  to  permit  rea¬ 
listic  contractor  maintenance  warranty. 

Such  ar  arrangement  would  mean  that  contractor  personnel  would  be 
required  at  the  intermediate  level  in  combat  cones  and  on  shipboard. 

There  is  prior  experience  with  such  arrangements.  Contractor  field  serv¬ 
ice  representatives  served  on  shipboard  and  in  field  combat  zones  during 
World  War  II,  the  Korean  War,  and  more  recently  during  the  war  in  South¬ 
east  Asia.  Hughes  Aircraft  Company,  for  example  (according  to  corre¬ 
spondence  from  J.B.  Boehlert  and  R.G.  Hardy),  had  75  field  support  per¬ 
sonnel  in  combat  zones  in  Vietnam  during  the  hostilities  there.  Nineteen 
of  these  people  were  there  for  over  6  years.  Twelve  more  Hughes  field 
support  people  served  on  shipboard  at  Yankee  Station.  Ken  Hemmick, 
Manager  of  Electronics  and  Reconnaissance  Systems  Field  Engineering  and 
Support  for  Westinghouse ,  reports  a  similar  set  of  statistics  for  that 


270 


WVS.fW'S1 w>y<imn»iWfgff>W  w*v^jv*w  avfl*  *3wa»** 


j 

organization.  In  this  case,  77  men  served  for  a  total  of  345  man-months 

y> 

in  South  Vietnam,  and  50  men  served  a  total  of  272  man-months  on  shipboard 
at  Yankee  Station.  Both  Westinghouse  and  Hughes  also  had  sizable  numbers 
/  of  men  in  other  areas  such  as  Israel,  Lebanon,  and  Turkey  (during  the 

period  of  martial  law  in  1971-72). 


s 
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These  experiences  suggeot  the  feasibility  of  a  worldwide  system  of 
contractor  maintenance  representatives  to  support  warranty  activities  on 
electronic  equipment.  The  numbers  of  personnel  required  for  a  large  field 
of  equipment,  organizational  arrangements  for  orderly  interaction  with 
local  military  maintenance  organizations,  and  SOPs  for  the  civilian  TDY  in 
peace  and  war  would  all  have  to  be  worked  out  as  part  of  an  increased  re¬ 
liance  on  CMWs  of  the  kind  being  considered  here. 

b.  Maintenance  After  Expiration  of  Warranty.  During  the  warranty 
period  the  contractor  is,  of  course,  responsible  for  all  aspects  of  main¬ 
tenance  of  his  equipment,  including  the  provision  of  test  equipment  and 
spare  piece-parts  and  subassemblies.  There  is  no  requirement  during  this 
period  for  detailed  maintenance  handbooks  or  maintenance  training  for 
military  personnel. 
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,  Since  all  of  the  above  would  later  be  required  in  the  absence  of  a 

continuing  arrangement  for  contractor  maintenance,  some  thought  must  be 
given  to  what  action  is  to  be  taken  when  the  warranty  period  expires. 

✓ 

Several  courses  of  action  are  possible: 


»  Provisions  could  be  rrade  in  the  initial  procurement  for  an 

orderly  phasing  in  of  Government  maintenance  toward  the  end  of 
the  warranty  period,  including  supply  of  the  missing  ingredients 
outlined  above.  This  approach  would,  in  general,  appear  to  limit 
the  compensatory  savings  that  should  be  expected  from  warranties, 
except  that  the  cost  of  reliability  improvement  and  associated 
maintenance  would  be  accounted  for  under  the  warranty  during  the 
early  period  of  equipment  introduction. 


•  The  original  contract  can  include  provisions  for  extending  the 
warranty,  either  by  means  of  a  priced  option  for  the  next  period 
or  by  a  stated  obligation  to  negotiate  an  extension  of  the 
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warranty  if  the  Government  elects  to  do  so.  It  would  seem  wise 
in  adopting  this  course  of  action  to  ensure  that  the  possibilit> 
of  sone  arrangement  suitable  to  the  Government  exists  throughout 
the  useful  life  of  the  equipment.  Continuation  of  the  warranty 
would  be  particularly  useful  if,  in  addition  to  the  benefits  of 
contractor  maintenance,  reliability  growth  during  the  next  period 
appears  to  be  a  definite  possibility. 

•  When  the  growth  of  field  reliability  reaches  a  plateau,  any  re¬ 
maining  benefits  of  contractor  maintenance  might  still  be  enjoyed 
without  the  warranty  provisions  by  negotiating  a  contract  for 
continued  maintenance  by  the  contractor.  This  would  obviate  the 
need  for  procuring  the  handbooks,  spares,  and  training  mentioned 
earlier.  Such  arrangements  can  take  the  form  of  an  annual  package 
maintenance  arrangement  for  a  fixed  price,  or  a  "call"  contract 
with  payment  on  a  time -and -materials  basis.  The  former  arrange¬ 
ment  is  no  doubt  preferable,  since  paperwork  is  simplified,  the 
contractor  is  restrained  by  the  fixed  price  to  a  more  efficient 
operation,  and  pricing  should  be  aided  by  historical  data  acquired 
during  the  preceding  warranty  period. 

When  a  contractor  maintenance  contract  is  resorted  to  (in 
lieu  of  extended  warranties)  consideration  should  be  given  to  the 
effect  of  competition  for  the  continuing  maintenance. 

6.  Problem  Areas 

In  view  of  the  limited  experience  to  date,  a  number  of  problems  or 
questions  remain  about  contractor  maintenance  warranties. 

a.  Airline  Versus  Military  Environment.  It  is  generally  agreed  that 
the  experience  of  the  airline  industry  has  been  favorable.  But  how  applic¬ 
able  to  DOD  is  that  experience?  The  airline  operational  structure  is  com¬ 
patible  with  efficient  warranty  administration.  The  equipment  is  readily 
accountable,  can  be  rapidly  returned  to  the  manufacturer,  is  generally  well 
within  the  state  of  the  art,  and  is  subject  to  industry-wide  pressure  for 
high  reliability  and  low  maintenance  cost.  Most  of  the  favorable  expe¬ 
rience-  -commercial  and  military — has  been  in  avionics.  How  CMWs  will  work 
in  other  areas  is  unknown. 
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b.  Administration  of  Warranties.  Government  experience  with  war¬ 
ranties,  primarily  short-term  warranties,  has  generally  been  unsatis¬ 
factory,  mainly  because  deficiencies  in  warranty  administration  have  pre¬ 
vented  the  Government  from  achieving  potential  benefits.  If  warranties 
extend  over  several  MTBFs,  if  no  alternative  repair  sources  are  available, 
and  if  many  equipments  are  procured  under  warranty,  the  Government  must 
build  an  administrative  and  management  structure  better  suited  to  this 
type  of  operation. 

c.  Comparative  Costs.  As  in  many  other  areas  covered  in  this  re¬ 
port,  the  difficulty  of  isolating  DOD  maintenance  costs  enters  the  war¬ 
ranty  picture.  The  costs  of  alternatives  are  definitely  relevant  to 
decisions  about  using  warranties.  Total  Government  costs  for  such  things 
as  special  handling  and  warranty  administration,  accommodation  of  con¬ 
tractor  maintenance  representatives,  and  costs  that  are  deferred  but  not 
avoided  have  to  be  considered.  Perhaps  more  difficult  is  determining  the 
costs  that  are  avoided  and  the  benefit  that  occurs  if  readiness  actually 
does  increase. 

d.  Impact  on  Industrial  Base.  Widespread  use  of  the  CMW  would  prob¬ 
ably  make  it  more  difficult  for  small  contractors  to  compete,  since  they 
are  less  likely  to  have  the  resources  and  credible  past  performance  to 
ensure  their  capability  to  follow  through.  Competition  for  major  systems 
and  subsystems  usually  involves  large  contractors  who  could  perform  more 
easily  under  the  CMW.  Performance  bonds  or  contingent  arrangements  with 
third  parties  might  help  to  alleviate  the  problem. 

e.  Modification  Strategies.  It  is  to  the  mutual  benefit  of  the 
Government  and  the  contractor  that  reliability  improvements  be  made  during 
the  warranty  period.  Whether  modification  should  be  rade  when  items  are 
returned  for  repair,  or  during  periodic  inspection,  or  in  the  field,  or 
under  some  other  arrangement  would  depend  on  availability  requirements, 
MTBF,  type  and  impact  of  the  modification,  and  other  factors.  This  area 
requires  careful  study  in  each  program. 

f.  Equipment  Interface  Problems.  To  minimize  disagreements  about 
causes  of  failure,  it  is  important  that  equipment  interface  specifications 
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be  carefully  drawn  up  and  that  questions  of  line  voltage  surges,  inade¬ 
quate  cooling,  and  so  on,  be  anticipated.  The  Arinc  report  previously 
referred  to  contains  examples  of  both  airline  and  military  warranty  agree¬ 
ments  that  address  these  and  other  problems. 

g.  Realizing  the  Benefits.  As  mentioned  above,  much  of  the  poten¬ 
tial  value  of  the  CMW  derives  from  costs  that  are  avoided  and  from  in¬ 
creased  readiness.  Active  management  in  areas  other  than  the  administra¬ 
tion  of  the  warranty  itself  will  be  required  to  realize  these  benefits. 

For  example,  if  maintenance  handbooks,  particularly  for  the  depot  level, 
are  still  procured,  or  if  manning  is  not  changed,  the  CMW  may  result  in 
increased  cost.  This  depends  on  policy  for  post-warranty  maintenance, 
which  would  have  to  be  worked  out  for  separate  programs,  and  fitted  into 
a  general  strategy  designed  to  capitalize  on  warranties  if  they  prove 
useful. 

7.  Findings  and  Recommendations 

a.  Findings 

•  Long-term  contractor  maintenance  warranties  provide  a  technique 

by  which  both  production  and  maintenance  costs  can  be  internalized 
to  a  single  responsible  organization:  the  supplier. 

•  Making  the  supplier-warrantor  responsible  for  both  production  and 
long-term  maintenance  costs  under  fixed-price  contracts  will 
strongly  motivate  him  to  design  equipment  so  as  to  reduce  the  sum 
of  these  costs,  which  constitute  a  major  fraction  of  the  life-cycle 
cost.  But  complete  transfer  of  an  unlimited  maintenance  risk  to 
the  contractor  may  be  impractical,  as  may  be  seen  by  analogy  to  the 
Total-Package  Procurement  process.  It  is  necessary  to  devise  new 
ways- -possibly  new  types  of  warranties — to  accomplish  this  in  a 
pragmatically  acceptable  manner. 

•  The  limited  experience  with  long-term  contractor  maintenance  war¬ 
ranties  to  date  suggests  that  they  in  fact  motivate  designs  and 
modifications  to  increase  reliability,  and  that  the  cost  of  con¬ 
tractor  maintenance  through  warranties  is  substantially  less  than 
just  the  direct  costs  of  military  maintenance  on  comparable  items. 
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•  Short-term  warranties  on  materials  and  workmanship  have  been  ex¬ 
tensively  invoked  in  the  past  in  military  electronics  procure¬ 
ments,  but  such  warranties  have  been  ineffectual  and  are  not 
comparable  to  long-term  contractor  maintenance  warranties. 

•  The  use  of  long-term  contractor  maintenance  warranties  can  serve 
as  a  competitive  alternative  to  military  repair  of  electronic 
equipment.^ 

•  Long-term  contractor  maintenance  warranties  have  application  to 
any  military  electronic  equipment  whose  failed  units  can  be  re¬ 
placed  in  the  field  and  conveniently  returned  to  the  contractor 
for  repair,  or  to  which  the  contractor  can  have  ready  access  for 
field  repair. 

•  The  costs  of  warranty  maintenance  should  take  into  account  the 
cost  of  any  additional  spare  replacement  units  required,  the  costs 
of  transportation  for  repair,  and  the  warranty  costs  themselves. 
These  costs  should  be  compared  with  the  costs  of  the  spare  compo¬ 
nents  and  the  logistic  system  required  to  supply  them  to  the 
field,  plus  the  true  direct  and  indirect  costs  of  military  main¬ 
tenance  . 

•  Post-warranty  maintenance  options  include  warranty  renewal,  main¬ 
tenance  contracts,  or  contractor  training  of  military  maintenance 
personnel.  Any  of  these  options  would  alleviate  the  need  for  ex¬ 
cessively  detailed  data  and  manuals. 

•  Trial  application  of  long-term  contract  maintenance  warranties  was 
requested  of  the  Services  by  DDR&E  and  ASD(ISL)  in  a  joint  memo¬ 
randum  of  27  August  1973. 

b.  Recommendations 

Extend  the  application  of  long-term  contractor  maintenance  war¬ 
ranties  to  military  electronics  procurements. 


irtrk  Highest  priority;  *★  high  priority;  ★  priority. 
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★★★  Make  known  the  intention  to  contract  for  maintenance  warranties 
on  production  equipment  at  the  time  development  is  initiated, 
so  that  the  contractor  will  design  to  minimize  total  costs  of 
production  and  warranty  maintenance. 

Establish  a  warranty  review  group  within  OSD  to  monitor  results 
of  trial  applications,  to  determine  desirable  warranty  contrac¬ 
tual  formats,  and  to  refine  the  categories  of  equipments  to 
which  warranties  are  most  applicable  and  for  which  warranties 
are  most  effective. 

irirk  Initially  apply  long-term  contractor  maintenance  warranties 

to  equipments  whose  failed  units  can  be  replaced  in  the  field 
and  conveniently  returned  to  the  contractor’s  plant  or  base 
for  repair,  or  to  which  the  contractor  can  have  ready  a- cess 
for  field  repair,  such  as:  airborne  communication,  navigation, 
and  identification  equipment;  modular  radars;  vehicular  com- 
muni  ation  sets;  complex  manpack  equipment  such  as  LORAN  C/D; 
forward-looking  infrared  (FLIR)  systems;  domestic  communica¬ 
tion,  data  processing,  and  radar  installations . 


irk*  Highest  priority;  ★★  high  priority;  ★  priority. 
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B.  STANDARDIZATION  AND  SPECIFICATIONS21 

Standardization  is  often  suggested  as  a  means  by  which  the  cost  of 
electronic  equipment  may  be  reduced  and  its  reliability  improved.  Con¬ 
ventionally,  standardization  is  envisioned  as  a  process  in  which  only  a 
limited  number  of  designs  of  systems,  equipment,  modules,  pieces,  and 
parts  are  selected  to  be  put  into  production  and  service,  with  the  follow¬ 
ing  expected  benefits : 

-  Longer-run  production  of  fewer  designs  should  reduce  unit  produc¬ 
tion  costs. 

-  Concentration  of  development  and  production  engineering  effort  on 
a  limited  number  of  selected  designs  should  lead  to  greater  pro¬ 
duction  uniformity,  higher  quality,  and  higher  reliability  of 
production  items. 

-  Limiting  the  number  of  designs  in  service  should  keep  down  the 
number  of  types  of  repair  parts  to  be  stocked  and  reduce  the  cost 
of  replacement  inventory. 

-  Limiting  the  number  of  deployed  designs  should  reduce  the  costs 
of  maintenance  labor  and  cut  the  training  requirements  for  main¬ 
tenance  technicians. 

Past  examples  of  standardization  of  military  electronic  equipment 
lead  to  serious  doubts  as  to  whether  the  foregoing  conventional  standardi¬ 
zation  approach  and  objectives  have  merit  when  applied  to  the  electronic 
equipment  in  weapons  systems. 

Any  standardization  approach  that  freezes  on  specific  selected  de¬ 
signs  for  a  long  period  of  time  is  simply  not  consistent  with  the  explo¬ 
sive  rate  of  advance  of  electronic  technology  and  the  military  need  for 
frequent  design  upgrading  to  improve  equipment  reliability  and  performance. 

In  subsequent  sections,  we  shall  discuss  approaches  to  military  elec¬ 
tronics  standardization  that  can  induce  cost  reduction  and  reliability 
improvement  without  design  stagnation.  It  will  be  seen  that  the  objec¬ 
tives  of  military  electronics  standardization  should  be  quite  different 
from  those  conventionally  assumed.  The  kinds  and  levels  of  equipment  to 
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which  standardization  is  applicable,  the  desirability  of  providing 
standard  environments,  and  methods  of  implementing  electronics  standard¬ 
ization  in  the  Department  of  Defense  will  be  considered. 

1.  Equipment  Standardization 

Past  standardization  of  equipment  has  been  a  kind  of  de  facto  accom¬ 
plishment  using  the  process  of  reprocurement,  sometimes  over  and  over,  of 
equipment  identical  to  a  previous  design. 

There  is  no  question  but  that  significant  cost  reductions  can  be 
achieved  by  this  process  when  it  is  price-competitive  (see  Section  III-F, 
on  production).  The  fatal  flaw  in  this  standardization  technique  is  that 
it  freezes  designs  in  a  fast-moving  technology.  Two  '’triumphs”  of  avi¬ 
onics  standardization  by  reprocurement  are  the  AN/ARC- 34  UHF  radio  set 
and  the  AN/ARN-21  TACAN.  The  ARC- 34  is  installed  in  24  types  of  Air  Force 
aircraft,  more  types  than  any  other  UHF  transceiver  except  the  ARC-27. 

The  ARN-21  is  installed  in  at  least  eight  types  of  aircraft,  more  types 
than  any  other  TACAN.  Yet  these  equipments  have  mean  flight  hours  between 
failures  of  only  83  hours  and  91  hours,  respectively--reliabilities  that 
are  only  about  one-third  of  those  to  be  expected  from  equipments  of  simi¬ 
lar  cost,  complexity,  and  vintage,  and  less  than  one- tenth  of  what  can  be 
attained  in  modern  designs  to  which  intensive  reliability  development 
effort  is  applied. 

In  other  words,  freezing  on  standard  designs  failed  to  yield  relia¬ 
bility. 

Moreover,  the  existence  of  these  standard  designs  failed  to  prevent 
the  proliferation  of  new  types:  at  least  15  additional  types  of  UHF  radio 
and  eight  types  of  TACAN  have  been  developed  and  added  to  the  inventory 
since  the  ARC- 34  and  ARN-21.  Thus,  one  of  the  important  products  that 
conventional  wisoom  expects  from  standardization  of  selected  designs  was 
not  met:  holding  down  the  number  of  designs  put  into  inventory.  The 
pressure  for  obtaining  improved  operational  performance  by  taking  advan¬ 
tage  of  the  benefits  offered  by  an  advancing  technology  overcame  the  de¬ 
sire  to  stick  with  old  designs  for  economic  reasons. 
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Thus,  the  key  to  successful  standardization  of  military  electronic 
equipment  is  in  providing  an  approach  that  is  consistent  with  the  need 
for  continuing  design  upgrading  and,  at  the  same  time,  achieving  the  goals 
of  reliability  improvement  and  reduced  cost.  To  accomplish  this,  the 
standardization  approach  should  meet  the  following  objectives: 

1.  Encourage  design  and  price  competition  by  ensuring  interchange- 
ability  of  competing  designs. 

2.  Encourage  periodic  internal  design  upgrading  and  reliability 
growth  by  avoiding  unnecessary  restriction  on  internal  design. 

3.  Ensure  "generation  interchangeability"  of  subsystems  and  equip¬ 
ments,  so  that  outdated  electronic  subsystems  and  equipment  can 
be  readily  replaced  by  new  versions  without  modifying  the 
vehicles  within  which  they  are  installed. 

4.  Facilitate  the  evolution  of  electronic  systems  and  variants  of 
systems  for  differing  applications  by  permitting  interchange  of 
system  units  that  have  differing  performance  characteristics. 
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5.  Ensure  interoperability  of  cooperative  systems,  such  as  commu¬ 
nication,  navigation,  and  identification  equipments. 

It  is  important  to  note  that  these  objectives  do  not  include  minimiz¬ 
ing  the  number  of  designs.  Rather,  the  object  is  to  encourage  the  simul¬ 
taneous  existence  of  several  interchangeable  designs  of  like  equipment  so 
that  the  user/purchaser  may  choose  among  designs  and  prices. 
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The  standardization  approach  that  meets  these  objectives  is  interface 
standardization  at  the  black-box,  LRU,  or  WRA  level.  Specific  recommenda¬ 
tions  with  regard  to  interface  standardization  and  "form-fit-function" 
specifications  were  made  in  Section  III-E,  "Design  to  Facilitate  Competi¬ 
tion,"  and  need  not  be  repeated  here.  However,  it  is  important  to  con¬ 
sider  the  kind  and  scope  of  electronic  equipment  and  systems  to  which 
interface  standardization  is  applicable. 

A  large  part  of  military  electronic  equipment--about  HU  percerit--is 
installed  in  weapons  systems--a ircraft,  missiles,  ships,  and  tanks.  The 
military  utility  of  these  weapons  systems  is  more  likely  to  be  limited  by 
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the  obsolescence  of  the  electronic  elements  that  serve  as  sensors  and 
control  systems  than  by  obsolescence  or  wearout  of  the  vehicles  themselves. 
Typically,  the  vehicles  may  become  obsolete  in  10  to  25  years,  while  the 
electronic  equipment  may  get  well  behind  the  state  of  the  art  in  5  years. 

In  aircraft,  about  20  percent  of  the  dollar  value  of  avionic  gear  is 
’’standard-function"  equipment- -that  is,  communication,  navigation,  and 
identification  equipment  that  is  in  common  use  and  operates  cooperatively 
with  similar  equipment  in  other  aircraft  or  on  the  ground.  Because  of  the 
massiveness  of  the  cooperative  system  of  which  the  standard-function 
equipment  is  part,  the  performance  standards  for  the  standard-function 
equipment  change  only  very  slowly.  The  equipment  usually  becomes  obsoles¬ 
cent  under  pressure  of  advancing  component  and  device  technology  rather 
than  pressure  of  new-system  performance  demands. 

The  remaining  80  percent  of  the  dollar  value  of  avionics  lies  in 
"mission-oriented"  electronics.  Radars,  forward-looking  infrared  imaging 
devices,  fire-control  and  bombing  systems,  tactical  navigators,  missile 
systems,  and  tactical  displays  are  subsystems  on  which  the  pressures  for 
obsolescence  include  not  only  the  advancing  device  technology  but  also  new 
systems  approaches  coupled  with  operational  needs.  Thus,  mission-oriented 
electronics  tends  to  become  obsolete  more  rapidly  than  standard-function 
gear. 

Thus,  a  paradoxical  situation  exists  in  which,  although  it  is  clearly 
easier  to  establish  interface  standards  for  standard-function  equipment 
because  of  its  relatively  stable  configuration,  the  mission-oriented  sub¬ 
systems  are  more  likely  to  require  early  and  frequent  upgrading  or  re¬ 
placement  in  order  to  extend  the  useful  lives  of  the  weapons  systems  of 
which  they  are  a  part. 

Examples  of  successful  interface  standardization  can  be  found  in  both 
commercial  and  military  systems.  The  most  frequently  referenced  examples 
are  those  of  airlines  avionic  equipment  standardized  by  the  Airlines  Elec¬ 
tronic  Engineering  Committee  (AEEC),  an  organization  that  works  under  the 
aegis  of  Aeronautical  Radio,  Inc.  After  extensive  discussions  and  nego¬ 
tiations  with  electronic  equipment  manufacturers  and  airframe  contractors, 


the  AEEC,  whose  membership  is  drawn  from  the  air  transport  industry, 
translates  operational  requirements  into  avionic  equipment  specifications/ 
These  specifications,  published  by  Aeronautical  Radio,  Inc.,  and  called 
"Arinc  Characteristics,"  cover  precisely  and  completely  the  required 
mechanical,  electrical,  and  environmental  interfaces  for  the  specified 
equipment,  together  with  the  required  equipmenc  functions  and  performance. 
They  do  not  specify  details  of  internal  design.  Thus,  they  are  "form-fit- 
function"  specifications.  Competing  manufacturers  who  design  to  Arinc 
characteristics  produce  equipments  that  may  differ  radically  in  internal 
design,  but,  by  reason  of  adherence  to  interface  specifications,  are 
interchangeable . 

Although  Arinc  characteristics  usually  have  been  prepared  to  cover 
individual  items  of  standard-function  avionics,  the  method  has  been  ex¬ 
tended  in  Arinc  Characteristic  582-2  to  cover  the  Mark  2  Air  Transport 
Area  Navigation  System  (Fig.  IV-1),  a  system  equal  in  complexity  to  many 
military  avionic  systems.  Thus,  there  exists  proof  that  large-scale 
systems  can  be  interface-standardized  on  a  black-box,  LR'l,  or  WRA  basis. 

At  this  point,  it  is  useful  to  point  out  that  interface  standardiza¬ 
tion  is  an  approach  that  can  be  used  either  in  conjunction  with  functional 
specifications,  as  in  Arinc  characteristics,  or  in  conjunction  with  con¬ 
ventional  military  specifications,  wherein  the  internal  processes,  piece- 
parts,  and  materials  are  specified  in  detail.  Although,  as  discussed 
elsewhere  in  this  report,  use  of  functional  specifications  is  recommended 
over  the  conventional  detailed-specif ication  approach,  interface  standard¬ 
ization  can  proceed  independently  and  is  not  contingent  upon  adoption  of 
this  recommendation. 

An  outstanding  example  of  the  manner  in  which  carefully  controlled 
interface  specifications  can  provide  a  framework  for  evolution  of  variants 
of  a  mission-critical  system  is  the  Navy's  Standard  Missile  program.  The 
program  involved  the  evolution  of  missiles  to  meet  different  threats  in  a 
field  of  rapidly  changing  technology.  It  invoked  standard  interfaces  with 
the  platform,  launchers,  etc.,  so  that  the  new  Standard  Missiles  could  be 
employed  on  the  older  TERRIER  and  TARTAR  ships  with  only  minor  (usually 


electrical)  modifications  required  aboard  ship.  Intramissile  interfaces 
were  established  and  controlled  so  that  new  technology  or  new  capability 
could  be  added  a  section  at  a  time,  and  as  a  result  new  missiles  repre¬ 
senting  completely  new  capabilities  have  been  developed  while  making  use 
of  existing,  available  standard  and  proven  missile  sections  and  elements. 


FIGURE  IV’’..  Complex  Air  Navigation  System  Covered  by  Arinc  Characteristic  582-2 


The  sketch  in  Fig.  IV-2  illustrates  the  several  members  of  the 
Standard  Missile  (medium- range)  family  and  the  degree  to  v^iich  standardi¬ 
zation  has  been  achieved.  Not  shown  is  the  fact  tnat  the  Standard  Mis¬ 
sile-1  (SM-1)  was  itself  developed  by  using  many  prior  proven  components, 
assemblies,  and  sections  from  TERRIER  and  TARTAR. 
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FIGURE  I V—2.  Medium-Range  Standard  Missile  Family  Derived  from  Combinations 
of  Components 


The  family  of  medium- range  Standard  Missiles  that  has  evolved  now 
includes  six  surface-to-air,  air-to-surface,  and  surface-to-surface  mis¬ 
siles  derived  from  various  combinations  of  seekers  (four  types),  fuzes 
(four  types),  warheads  (three  types),  motors  (two  types),  and  steering 
control  systems  (one  type). 

The  benefits  of  this  approach  can  be  seen  in  two  areas.  First,  as 
shown  in  Fig.  IV-3,  the  manpower  in  man-months  and  the  calendar  time 
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required  to  achieve  the  first  successful  guided  test  vehicle  of  each  suc¬ 
cessive  type  have  been  substantially  smaller  than  what  was  required  for 
the  initial  Standard  Missile  (SM-1).  Second,  despite  continuing  perform¬ 
ance  improvement  in  successive  missile  types  (e.g.,  doubling  in  altitude 
capability,  quadrupling  in  range),  missile  production  costs  have  stayed 
essentially  constant. 


FIGURE  IV-3.  Manpower  and  Calendar  Time  to  Achieve  First  Successful  Guided 
Test  Vehicle 
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2.  Environmental  Standards  and  Controlled  Environments 


Environmental  design  criteria  for  electronic  equipment  are  imbedded 
in  the  applicable  general  specifications.*  Characteristics  of  the  operat¬ 
ing  environment  that  are  specified  include  altitude,  temperature,  moisture, 
sand,  dust,  salt  atmosphere,  fungus,  acceleration,  vibration,  and  shock. 
Environmental  qualification  tests  are  covered  in  MIL-STD-810. 

The  environment  is  both  "natural”  and  "induced."  MIL-STD-210  is  a 
compilation  of  measured  natural  environmental  conditions  throughout  the 
world.  The  induced  environment  is  primarily  shock  and  vibration,  and  has 
been  established  by  measuring  instruments  on  the  various  platforms- -people, 
aircraft,  missiles,  ships,  tanks,  and  trucks--on  which  electronic  equip¬ 
ment  is  to  be  installed.  Environmental  design  criteria  take  into  account 
the  range  of  environments  likely  to  be  encountered  by  the  various  platforms 
and  the  degree  of  isolation  and  protection  afforded  the  electronic  equip¬ 
ment  as  installed. 

Despite  the  decades  of  effort  in  establishing  environmental  design 

23 

criteria,  environmental  failures  continue  to  occur.  In  a  recent  study 
of  175  aircraft  in  Southeast  Asia  over  a  2-year  period,  it  was  determined 
that  52  percent  of  the  avionics  failures  were  environmentally  caused.  The 
cost  of  environmental  failures  is  estimated  at  more  than  $100,000  per  air¬ 
craft  per  year.  The  distribution  of  environmental  failure  causes  was  as 
follows : 


Temperature 

42% 

Vibration 

28% 

Humidity 

20% 

Sand  and  Dust 

6% 

Shock 

2% 

Altitude 

2% 

Elimination  of  these  environmentally  caused  failures  would  provide  bene¬ 
fits  of  $400  million  per  year  in  a  fleet  of  4,01 J  tactical  aircraft. 


*There  are  13  such  general  specifications  covering  the  various  classes 
and  applications  of  electronics. 
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Environmental  failures  also  occur  in  ship  and  other  installations. 
Discussions  with  Air  Force  and  Navy  laboratory  personnel  indicate  that 
testing  in  accordance  with  the  procedures  specified  by  MIL-STD-810  is 
inadequate  in  that  it  fails  to  expose  the  equipment  to  environmental 
stresses  in  ways  that  realistically  emulate  those  operationally  encoun¬ 
tered:  combinations  of  temperature,  altitude,  and  humidity;  lemperature 
cycling;  combinations  of  sand,  dust,  and  moisture;  vibration  for  periods 
of  time  long  enough  to  possibly  induce  fatigue. 

Additionally,  the  environmental  criteria  of  the  general  specifica¬ 
tions  have  inadequacies.  For  both  ships  and  aircraft,  the  vibration, 
blast,  and  shock  due  to  firing  of  one’s  own  weapons  are  not  adequately 
covered,  according  to  laboratory  experts.  On  ships,  low- temperature 
requirements  are  overemphasized;  while  on  aircraft,  cycling  of  temper¬ 
atures  in  combination  with  altitude  and  humidity  is  underemphasized. 

Because  of  the  desirability  of  diversifying  the  applicability  of 
electronic  equipment  to  many  platforms  of  a  class,  rather  than  designing 
equipment  that  is  unique  to  a  particular  platform,  the  approach  of  aggre¬ 
gating  environmental  profiles  to  arrive  at  expected  environmental  extremes 
within  which  equipment  shall  function  appears  to  be  appropriate  and  should 
be  continued.  There  is,  of  course,  a  cost  and  overspecification  penalty 
that  must  be  paid  for  this  form  of  standardization. 

There  is,  however,  another  approach  that  requires  continued  design 
and  development  and  serious  investigation  and  study  to  determine  its  rela¬ 
tive  costs  and  benefits.  That  approach  is  the  provision  of  a  benign,  pro¬ 
tected  environment  in  appropriate  platf orms--a ircraf t,  ships,  vans,  and 
helihuts.  In  such  circumstances,  clean,  moisture-free,  constant-tempera- 
t ire  air  can  be  provided.  Enclosures  can  be  isolated  from  shock,  vibra¬ 
tion,  and  blast.  The  benefits  of  such  an  approach  are  indicated  to  some 
degree  by  the  differences  in  price  of  commercial  airlines  avionic  gear, 
which  operates  in  a  controlled  environment,  and  avionic  equipment  of  very 
similar  performance  characteristics  (but  which  must  operate  in  a  more 
severe  environment)  procured  by  the  military.  Price  differences  of  two  to 
one  (military  versus  commercial)  are  not  uncommon,  though  part  of  this 
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difference  in  price  must  be  accounted  for  by  imposition  of  arbitrary 
"how-to”  military  specifications  and  by  competition-restrictive  military 
procurement  practices. 

To  bring  this  approach  into  more  general  military  usage,  it  will  be 
necessary  to  carry  out  programs  of  measurement  aimed  at  updating  the 
environmental  criteria  of  general  specifications  and  of  qualification 
test  procedures.  It  will  also  be  necessary  to  encourage  cost- benefit 
analyses  and  development  efforts  related  to  the  provision  of  standard, 
benign- environment  enclosures  for  electronic  equipment. 

3.  Elimination  of  Unnecessarily  Restrictive  Specifications 

In  an  Air  Force  sponsored  study  of  contract  requirements  shown  as 
"Q  Eagle,"  Lamont  Brown  and  Paul  Lee  of  Hughes  Aircraft  Company  examined 
the  hierarchies  of  technical  specifications  imposed  by  the  military  Serv¬ 
ices  in  development  contracts.  They  found,  for  a  typical  electronic 
system  of  14,000  to  100,000  electronic  components,  that  there  were  3,000 
traceable  specifications  applicable. 

These  specifications  are  invoked  through  application  of  any  of  the  13 
general  specifications  covering  the  various  classes  of  electronic  equip¬ 
ment,  such  as  MIL-E- 16400  for  ship  equipment,  MIL-E-5400  for  airborne 
equipment,  or  MIL-E- 4158  for  ground  equipment.  The  general  specifications 
themselves  contain  hundreds  of  reference  specifications.  In  addition, 
they  invoke  MIL- Bulletin-400  and  MIL-STD-454,  each  of  which,  in  turn,  in¬ 
vokes  a  tier  of  700  to  800  specifications. 

Most  of  the  reference  specifications  cover  parts,  materials,  finishes, 
and  processes.  Many  are  duplicative  and  overlapping,  and  in  some  cases 
conflicting.  Finishes,  for  example,  are  covered  in  20  different  specifica¬ 
tions.  The  main  emphases  of  the  reference  specifications  are  on 

-  Physical  rather  than  functional  requirements 

-  Finish  and  appearance 

-  Fabrication  practices 
Pedigree  of  parts  and  materials. 
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Though  these  reference  specifications  are  frequently  related  only 
remotely  and  indirectly  to  the  objective  of  realizing  the  desired  perform¬ 
ance  of  the  electronic  system  to  which  they  apply,  they  provide  a  ready 
basis  for  rejection  by  Government  inspectors  of  equipment  that  is  totally 
satisfactory  from  a  functional  standpoint.  Because  of  the  vastness  of  the 
number  of  applicable  specif ications ,  a  potential  for  their  selective  en¬ 
forcement  exists  that  may  be  unfairly  discriminating  against  or  in  favor 
of  competing  contractors.  The  costs  of  application  and  enforcement  of 
these  specifications  appear  to  be  quite  large  in  dollars,  delays,  and 
irritation.  There  are  very  substantial  administrative  costs,  for  example, 
associated  with  ensuring  material  conformity  with  applicable  specifica¬ 
tions  or  obtaining  waivers  if  conforming  material  is  inapplicable  or  un¬ 
available  . 

Specifications  of  the  ”how  to  do  it”  variety  are  described  by  Brown 
and  Lee  as  "monuments  to  people  who  got  stung.”  There  remains,  of  course, 
the  question  of  whether  continued  invocation  of  these  specifications  is 
essential  to  preclude  the  purchaser’s  being  stung  in  the  future.  Compara¬ 
tive  examples  from  the  practices  of  the  commercial  airlines  and  the  mili¬ 
tary  indicate  that  the  answer  to  that  question  is  negative.  Myron  F. 
Wilson  of  Collins  Radio  Company  points  out  that  an  airlines  VHF  trans¬ 
ceiver  is  specified  by  just  10  documents,  while  the  Air  Force  AN/ARC-XXX 
VHF  transceiver  invokes  456  standards  and  specifications  (Fig.  IV-4). 

Vet,  in  general,  airline  electronic  equipment  is  cheaper  than  military 
equipment  of  equivalent  type  and  is  just  as  reliable. 

The  approach  of  the  a  Jr  transport  industry  relies  primarily  on  speci¬ 
fication  of  the  operational  performance  required  of  electronic  equipment 
and  specification  of  those  physical,  environmental,  and  electrical  inter¬ 
faces  that  will  ensure  the  interchangeability  of  equipments  built  to  the 
same  specifications.  The  success  of  the  air  transport  industry  approach 
appears  to  be  based  on  the  following  factors: 

Specifications  (i.e.,  Arinc  characteristics)  are  the  product  of  a 
mutual  effort  of  the  airline  users  and  the  electronic  equipment 
suppliers,  and  hence  realizability  is  an  important  implicit  in¬ 
gredient  . 
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DOD  TOTAL:  456  DOCUMENTS 


ARINC  CHARACTERISTIC  S46  OR  S66A  -  AIRBORNE  VHE 
COMMUNICATIONS  TRANSCEIVER  SYSTEM 


—  •  ARINC  CHARACTERISTIC  NO  4S4  -  AIR  TRANSPORT 

EQUIPMENT  CASES  AND  RACKING 

—  •  ARINC  CHARACTERISTIC  NO.  410  -  MARK  2  STANDARD 

FREQUENCY  SELECTION  SYSTEM 

—  ■  FAA  TSO  -  6375  (TECHNICAL  STANDARD  ORDER)  -  VHF  RADIO 

COMMUNICATIONS  TRANSMITTING  EQUIPMENT  OPERATING  WITHIN 
THE  RADIO  FREQUENCY  RANGE  OF  118  136  MEGACYCLES 

—  •  FAA  TSO  -  C365  -  VHF  RADIO  COMMUNICATIONS  RECEIVING 

EQUIPMENT  OPERATING  WITHIN  THE  RADIO  FREQUENCY  RANGE 
OF  III  1 36 MEGACYCLES 

—  ■  RTCA  PAPER  120  SI/DO  TO*  -ENVIRONMENTAL  TEST  PROCEDURES- 

AIRBORNE  ELECTRONIC  EQUIPMENT  OR -DO-138  ENVIRONMENTAL 
CONDITIONS  AND  TEST  PROCEDURES  FOR  AIRBORNE  ELECTRONIC/ 
ELECTRICAL  EQUIPMENT  AND  INSTRUMENTS 

—  ■  RTCA  PAPER  130  61/0010*  -  MINIMUM  PE  RFORMANCE  STANDARD- 

AIRBORNE  RADIO  COMMUNICATIONS  RECEIVING  EQUIPMENT 
OPERATING  WITHIN  THE  RADIO  FREQUENCY  RANGE  OF  1I7B75- 
138  000  MEGACYCLES 

—  •  RTCA  PAPER  134  61/DO  110  -  MINIMUM  PERFORMANCE  STANDARDS- 

AIRBORNE  RADIO  COMMUNICATIONS  TRANSMITTING  EOUIPMENT 
OPERATING  WITHIN  THE  RADIO  FRFOUENCY  RANGE  OF  117  975  - 
136  000  MEGACYCLES 

—  ■  PART  15  OF  THE  CODE  OF  FEDERAL  REGULATIONS.  SUBPART  C 

IRECEIVERI 

—  ■  PART  *7  OF  THE  CODE  OF  FEDERAL  REGULATIONS  -  TRANSMITTER 
I  -•  AT  A  -  100  INSTRUCTION  BOOKS 

ATI  TOTAL:  10  DOCUMENTS 


FIGURE  IV-4.  Comparative  Specifications  and  Standards  Requirements  for  Equivalent 
DOD  and  Air  Transport  Industry  Equipment 
(Source:  Ref.  24) 
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-  The  widespread  provision  of  long-term  warranties  (similar  to  the 
contractor  maintenance  warranties  discussed  elsewhere  in  this  re¬ 
port)  by  equipment  suppliers  assures  the  purchaser  that  he  will 
get  the  required  functional  performance  despite  his  not  specify¬ 
ing  internal  design  details. 

The  ensurance  of  interchangeability  of  competing  equipments  built 
to  the  same  specification  encourages  continuing  design  and  price 
competition  between  contending  suppliers  and  promotes  product 
improvement;  and  the  product  choices  thereby  available  to  the  pur¬ 
chaser  also  mitigate  the  need  for  specification  of  details  of  in¬ 
ternal  design. 

A  fundamental  problem  of  military  specifications  and  standards  for 
electronics  fabrication  practices,  finishes,  and  processes  is  that  the 
vast  and  rapid  shifts  in  technology,  combined  with  the  sluggishness  of 
the  bureaucracy,  almost  ensure  that  military  specifications  and  standards 
will  restrict  tomorrow’s  electronics  to  yesterday’s  practices.  At  the 
same  time,  the  immutable  military  policy  of  admitting  ingenuous  novices 
in  military  electronics  design  and  manufacture  to  the  competition  for 
development  and  production  of  hardware  argues  in  favor  of  retaining  such 
specifications  and  standards  as  instructive  guidelines  for  the  naive,  even 
though  those  specifications  and  standards  may  be  obsolescent  and,  to  the 
most  advanced  suppliers,  even  irrelevant  and  counterproductive. 

The  elimination  of  the  MIL- SPEC  burden  can  substantially  reduce  the 
cost  of  electronic  systems.  The  Swiss  TARAN  airborne  fire-control  and 
missile  system,  where  MIL-SPECs  were  not  applicable,  was,  according  to 
Hughes  Aircraft  Company  representatives,  lower  in  cost  of  material  than 
equivalent  U.S.  systems  by  25-50  percent.  According  to  Hughes,  the  equip¬ 
ment  has  performed  to  the  complete  satisfaction  of  the  Swiss  Government, 
and  the  cost  to  Hughes  of  repairs  under  the  warranty  has  been  negligible. 

4.  Electronic  Standards  Program  Implementation 

The  importance,  utility,  and  need  for  interface  (form-fit-function) 
standardization  at  the  electronic  equipment,  subsystem,  and  system  level 
have  been  established  earlier  in  this  chapter  and  in  Section  III-E.  The 
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desirability  of  providing  standards  that  will  permit  interchangeability 
and  interoperability  of  electronic  equipment  and  systems  among  the  Serv¬ 
ices  has  also  been  pointed  out.  Finally,  the  benefits  of  providing 
standard  environments  within  which  electronic  equipment  for  ships,  air¬ 
craft,  and  vehicles  are  to  operate  has  been  demonstrated. 

The  multi-Service  character  of  the  electronics  standardisation  task 
and  the  need  for  broad  policy  changes  to  accomplish  standardization  sug¬ 
gest  the  need  for  an  electronic  standards  organization  within  the  Office 
of  the  Secretary  of  Defense. 

Existing  institutional  vehicles  for  standardization  are  two.  DOD 
Directive  4120.3,  entitled  "Department  of  Defense  Standardization  Pro 
grams,"  dated  June  6,  1973,  establishes  policies  and  assigns  responsi¬ 
bilities  for  the  Defense  Standardization  Program.  The  implementing 
regulations  of  the  Army,  Navy,  and  Air  Force  substantially  repeat  the  DOD 
policies.  Another  DOD  directive,  5100.35,  established  the  Military  Commu¬ 
nications  Electronics  Board  and  assigned  as  one  of  the  Board  functions  the 
establishment  of  "principles  and  procedures  for  obtaining  compatibility 
and  standardization  of  communications-electronics  systems  and  equipments." 

It  appears  that  DOD  Directive  4120.3  can  be  the  vehicle  for  the 
establishment  of  an  effective  electronic  standards  organization.  To 
accomplish  this,  the  Defense  Materiel  Specifications  and  Standards  Board, 
with  the  concurrence  of  ASD(T),  should,  under  paragraph  VII  B2  of  the  DOD 
Directive,  recommend  the  establishment  of  an  Electronic  Standards  Panel 
(ESP),  with  the  authority  and  responsibility  to  promulgate  multi-Service 
electronic  standards  and  promote  the  cause  of  electronic  equipment,  sub¬ 
system,  and  system  standardization,  both  Single-Service  and  multi-Service. 
The  ESP  should  be  given  the  further  authority  to  establish  continuing  (as 
opposed  to  ad  hoc)  committees,  to  which  may  be  delegated  segments  of  the 
authority  and  responsibility  of  the  ESP. 

5.  Findings  and  Recommendations 

a .  Findings 

•  In  the  rapidly  moving  technology  of  military  electronics,  the 
standardization  that  occurs  because  of  repeated  procurements  of 
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the  same  design  can  result  in  technological  stagnation,  mediocre 
reliability,  and  excessive  proliferation  of  alternative  equip¬ 
ments.  This  has  been  exemplified  by  the  AN/ARC- 34  UHF  radio  set 
and  the  AN/ARN-21  TACAN. 

•  By  way  of  contrast,  interface  standardization  at  the  black-box, 
LRU,  or  WRA  level  provides  a  practical  form  of  standardization 
which  has  been  shown  to  work  both  in  the  civilian  airline  in¬ 
dustry  and  in  military  mission-oriented  equipment,  such  as  the 
Navy's  Standard  Missile.  As  used  by  the  airline  industry,  the 
interface  standardization  approach  is  combined  with  functional 
specifications,  that  is,  "form-fit- function"  standardization. 

This  has  the  advantage  that  wnile  the  interface  is  standardized , 
the  internal  configuration  of  the  unit  can  evolve  as  technology 
changes,  taking  advantage  of  new  devices  and  new  materials. 
Interface  standardization  can  be  used  in  conjunction  with  mili¬ 
tary  standards  for  components  and  workmanship.  Limitations  on 
the  evolution  inside  the  unit  result,  but  these  specifications 
provide  a  degree  of  insurance  against  the  mistakes  of  an  incom¬ 
petent  or  greedy  vendor.  In  either  case,  technological  progress 
is  not  halted  by  standardization.  Moreover,  interchangeability 
between  old  and  new  generations  of  electronics  becomes  a  practical 
reality,  and  the  need  for  modifications  to  an  installation  to 
accommodate  the  new  equipment  is  eliminated.  With  interface 
standardization,  production  costs  can  be  held  down  by  competition 
among  interchangeable  designs,  and  new  systems  can  be  synthesized 
largely  from  proven  standard  units. 

•  Strict  military  environmental  requirements  imposed  on  equipment 
and  systems  cause  great  increases  in  cost.  The  provision  of  more 
benign  standard  environments  for  electronic  equipments  through 
control  of  humidity  and  temperature  and  isolation  from  shock  and 
vibration  would  make  possible  the  use  of  cheaper  and  more  readily 
available  devices. 

•  In  an  area  as  dynamic  as  electronic  technology,  the  vast  DOD 
system  of  military  standards  and  specifications  is  too  sluggish 
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to  follow  the  rapid  advances  in  technology.  But  by  providing 
instructive  guidelines  for  the  uninitiated,  it  does  have  the  valu¬ 
able  function  of  admitting  novices  in  military  electronics  design 
and  manufacture  to  the  competition  for  development  and  production 
of  hardware. 

•  Integrated-circuit  development  is  being  driven  by  commercial 
rather  than  military  demand,  and  the  production  prices  of  such 
items  produced  in  commercial  volume  are  very  low.  Military  equip¬ 
ment  developers  should  rrake  use  of  the  existing  library  of  commer¬ 
cial  MSI  and  LSI  components  where  feasible,  rather  than  entering 
into  uniquely  military  integrated-circuit  developments;  and  de¬ 
pendence  on  a  single  source  for  such  components  should  be  avoided 
wherever  possible.2-3 

•  The  impact  of  standardization  and  specifications  on  electronics 
cost  is  of  such  large  magnitude  that  establishing  electronics 
standardization  and  specification  policy  should  be  undertaken  in 
the  Office  of  the  Secretary  of  Defense. 

b.  Rec  ommenda  t  ion  s 

DOD  should  establish  an  Electronic  Standards  Panel  having  re¬ 
sponsibility  and  authority  to 

1.  Promulgate  policy  requiring  that  the  Services  include 
electrical,  mechanical,  and  environmental  interface 
specifications  in  specifications  for  electronic  equip¬ 
ment  . 

2.  Promulgate  policy  requirinq  that  the  Services  take 
steps  toward  ensuring  that  new  electronic  equipments 
that  are  likely  to  replace  older  equipments  in  air¬ 
craft,  ground  vehicles,  and  other  platforms  will  be 
made  electrically,  mechanically,  and  environmentally 
interchangeable  with  the  older  equipments,  of  similar 
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types,  so  that  the  new  equipments  can  be  substituted 
for  the  old  without  costly  installation  modification. 

3.  Promulgate  policy  requiring  that  equipment,  subsystems, 
or  systems  of  similar  types  be  developed  to  the  same 
interface  specifications,  so  that  they  may  be  inter¬ 
changed. 

*k  4.  Promulgate  specific  interface  standards  for  classes  of 
equipment  used  by  more  than  one  Service. 

*★  5.  Establish  and  promulgate  standards  for  the  thermal, 

atmospheric,  vibration,  shock,  mounting,  shielding, 
and  power- source  environments  to  be  provided  by  air¬ 
craft,  ships,  and  vehicles  in  which  electronics  is  to 
be  installed.  This  should  include  standards  for 
benign-environment  enclosures  wherever  these  are  feas¬ 
ible  and  cost-effective. 

6.  With  the  concurrence  of  and  to  the  extent  authorized 
by  the  Military  Communications  Electronics  Board, 
establish  and  promulgate  standards  for  the  signals  to 
be  transmitted  or  interchanged  in  cooperative  systems, 
such  as  communications,  navigation,  and  identification 
systems. 

★★  7.  Review  Service  forecasts  of  electronic  equipment  needs 
in  order  to  determine  those  types  and  classes  to  which 
uniform  standards  should  be  applied,  and  act  to  ensure 
that  they  are  applied. 

8.  Establish  and  promulgate  DOD  standards  for  the  multi¬ 
plexing  and  interchange  of  digital  data  among  elec¬ 
tronic  equipments  within  ships  and  aircraft. 

9.  Promulgate  policy  designed  to  ensure  maximum  compati¬ 
bility  of  military  standards  with  commercial  practices. 


V 
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★★  10.  Review  existing  standards  and  specifications  for 

parts,  materials,  finishes,  processes,  and  other 
aspects  of  the  internal  design  of  military  electronics 
to  determine  which  of  these  should  be 

a.  Strictly  enforced 

b.  Subject  to  the  substitution  of  the  contractor- 
validated  alternative 

c.  Regarded  as  advisory  only 

d.  Revoked. 

The  several  general  design  specifications  used  in  most 
electronics  procurement  (e.g.,  MIL-E- 16400,  MIL-E- 
5400,  MIL- I- 983)  should  receive  particular  early 
attention. 

★*  ll.  Issue  up-to-date  guidance  on  military  utilization  of 

standard  commercial  LSI  and  MSI  items,  with  particular 
attention  to  the  need  for  multiple  sources  and  avoid¬ 
ance  of  military- unique  designs. 

★*  DOD  Directive  4120.3  can  be  the  vehicle  for  the  establishment  of 
an  effective  electronic  standards  organization.  In  order  to 
accomplish  this,  the  Defense  tfeiteriel  Specifications  and  Stand¬ 
ards  Board  should,  under  paragraph  VII  B2  of  the  Directive, 
recommend  the  establishment  of  an  Electronic  Standards  Panel 
(ESP),  with  the  authority  and  responsibility  to  promulgate 
multi-Service  electronic  standards  and  promote  the  cause  of 
standardization  of  electronic  equipments,  subsystems,  and  sys¬ 
tems,  both  single-Service  and  multi-Service.  The  ESP  should  be 
given  the  further  authority  to  establish  continuing  (as  opposed 
to  ad  hoc)  committees,  to  which  may  be  delegated  segments  of  the 
authority  and  responsibility  of  the  ESP.  Once  established,  the 
ESP  should  organize  to  undertake  formulation  and  promulgation  of 
the  policies  recommended  above. 
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C.  SOFTWARE;  DIGITAL  SYSTEM  ARCHITECTURE 

We  give  to  necessity  the  praise  of  virtue. 

-- Marcus  Fabius  Quintilianus 

The  fast-growing  application  of  digital  information  processing  to 
military  operations  makes  the  subject  of  its  cost  and  reliability  an  im¬ 
portant  topic  for  special  consideration  in  the  Electronics-X  Study.  Two 
questions  have  arisen  in  the  course  of  the  study:  the  serious  problem  of 
software  cost  escalation,  and  the  best  directions,  if  any,  for  computer 
s  ta  nda  rd  iza  t  ion . 

In  subsequent  paragraphs,  it  will  be  shown  that  these  two  questions 
are  closely  coupled.  The  amount  and  complexity  of  software  required  are 
related  to  the  selected  processor  architecture;  and  standardization,  if 
judiciously  accomplished,  can  permit  structuring  of  processors  specifi¬ 
cally  oriented  to  the  problems  to  be  solved  and  can  minimize  the  required 
software  without  jeopardizing  flexibility. 

1.  Software 

For  the  purposes  of  this  discussion,  software  includes  computer  pro¬ 
grams  and  their  documentation  and  excludes  the  logic  design  of  processor 
hardwre.  The  software  "problem"  is  in  fact  many  problems:  software  is 
often  excessively  costly,  late  in  completion,  poor  in  performance,  and 
"unreliable."  Its  development  status  is  inadequately  visible. 

Some  of  these  difficulties  can  be  discussed  in  quantitative  terms. 

For  example,  software  cost  has  become  a  very  substantial  portion  of  system 

26 

cost  in  military  electronics.  According  to  Barry  W.  Boehm  of  the  Rand 
Corporation,  the  Air  Force  expended  between  $1  billion  and  $1.5  billion  on 
software  in  1972 — about  three  times  its  expenditure  on  computer  hardware. 
The  Worldwide  Military  Command  and  Control  System  is  estimated  to  require 
$722  million  for  software,  as  opposed  to  $50  million  to  $100  million  for 
hardware.  Other  examples  of  high  software  cost  are  $200  million  for  the 
IBM  OS/360  and  $250  million  for  the  Semi-Automatic  Ground  Environment 
(SAGE). 
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Despite  the  fact  that  the  ratio  of  software  to  hardware  costs  is 
already  high,  that  ratio  can  be  expected  to  increase  unless  new  approaches 
are  undertaken.  Hardware  cost  per  function  is  decreasing  rapidly  as  tech¬ 
nology  advances,  but  software  productivity,  despite  regular  progress,  is 
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not  keeping  up.  According  to  Beum  and  Levin,  software  productivity  has 
approximately  doubled  over  the  last  15  years,  while  hardware  throughput 

(instructions  per  second  per  dollar)  has  improved  fiftyfold.  Williman  ard 
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O'Donnell  1  point  out  a  reduction  in  1-microsecond-access-time  memory  cost 
by  a  factor  of  1000  in  10  years. 

Quantitative  indications  of  the  software  "unreliability"  problem  can 

n  /r 

be  discerned  from  the  approxinate  distribution  of  effort  in  software  de¬ 
velopment,  which  is  remarkably  uniform  for  large-scale  systems: 

Program  analysis  and  design  (after  the 

functional  specifications  of  a  system 

have  been  completed)  34% 

Program  coding  and  auditing  18% 

Program  integration,  checkout,  and  test  48%. 

The  48  percent  of  the  effort  expended  in  software  integration,  check¬ 
out,  and  test  illustrates  the  extent  of  the  difficulties  in  correcting 
functional  and  coding  errors.  When  the  software  is  finally  delivered  as 
part  of  an  operational  military  system,  some  of  these  errors,  hitherto  un¬ 
discovered,  come  to  light  in  operations.  Hence  the  term  software  "unre¬ 
liability"  is  a  euphemism  for  design  errors;  software,  unlike  hardware,  is 
seldom  subject  to  spontaneous  failures  due  to  imposed  environmental 
stresses. 

In  hardware,  the  expected  failure  rate  and  the  cost  are  proportional 
to  system  complexity  or  parts  count.  In  software  the  situation  is  analo¬ 
gous  :  the  number  of  errors  to  be  expected  in  a  program  and  the  cost  of 
the  program  are  proportional  to  the  number  of  instructions.  Thus,  the 
prime  step  in  cutting  the  cost  and  increasing  the  reliability  of  software 
is  to  reduce  its  complexity.  To  accomplish  this  reduction,  there  are 
three  fundamental  possibilities: 
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1.  Reduce  and  simplify  the  functional  requirements  of  the  system. 

2.  Write  the  program  in  a  high-level  language  to  cut  the  number  of 
instructions  programmers  must  write. 

3.  Improve  the  match  between  the  hardware  and  the  problem  to  be 
solved. 

The  latter  step  brings  out  the  importance  of  a  thorough  preliminary 
system  design,  taking  into  account  not  only  the  architecture  and  capa¬ 
bilities  of  the  hardware  to  be  provided  but  also  the  extent  and  nature  of 
the  software  to  complement  it.  It  must  be  recognized  that  the  complexity 
and  extent  of  the  software  may  often  be  considered  a  measure  of  the  mis¬ 
match  of  the  hardware  to  the  problem. 

Nowhere  else  in  the  electronics  arena  is  the  mismatch  of  the  hard¬ 
ware  to  the  problem  so  evident  as  in  tactical  data  processing.  In  commu¬ 
nications  system  design,  intense  preliminary  design  effort  is  undertaken 
to  ensure  a  proper  match.  The  communications  medium  is  analyzed  for  its 
attenuation,  reverberation,  frequency  response,  and  noise  characteristics. 
The  most  appropriate  operating  frequency  range,  channelization,  and  signal 
structure  are  determined  by  analysis;  power  and  sensitivity  requirements 
are  determined;  and  transmitters  and  receivers  are  designed  to  match  the 
needs.  Similarly,  in  sonar  and  radar  system  design,  the  volumetric  cover¬ 
age,  the  medium,  the  unwanted  background  reflections,  the  jamming  poten¬ 
tial,  and  the  target  characteristics  are  analyzed,  and  the  transmitter, 
receiver,  antenna,  scanning  system,  signal  structure,  and  moving-target- 
indicator  system  are  then  designed.  In  contrast,  the  design  of  military 
tactical  data  systems,  with  only  a  very  few  exceptions,  begins  with  the 
selection  of  a  "general- purpose"  computer  because  it  is  "flexible,"  be¬ 
cause  it  exists  (perhaps  as  a  military  "standard"),  or  because  it  is  hoped 
to  be  about  to  come  into  existence .  It  is  a  peculiar  characteristic  of 

the  "general-purpose"  computer  selected  that  its  design  and  structure  are 
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almost  always  totally  uninfluenced  by  the  problem  to  be  solved.  If 
carefully  chosen,  the  computer  may  have  enough  speed  and  memory  capacity, 
but  it  is  almost  universally  a  single-instruction-stream,  single-data- 
stream  sequential  machine--a  descendant  of  what  John  von  Neumann  developed 
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in  1946,  brought  to  a  high  state  of  evolution  by  manufacturers  of  general- 
purpose  machines  to  satisfy  a  wide  variety  of  customers  who  have  an  enor¬ 
mous  diversity  of  scientific  and  business  problems  to  be  solved. 

After  the  computer  has  been  selected,  the  arduous  task  of  matching  it 
to  the  tactical  problem  begins.  Quoting  R.  Turn  of  the  Rand  Corporation, 50 
"In  the  past,  software  techniques  have  been  used  to  compensate  for  hard¬ 
ware  deficiencies  in  a  number  of  CC  (command  and  control)  data-processing 
systems.  Such  deficiencies  generally  have  been  associated  with  computa¬ 
tional  speed,  rigid  system  design,  and  long  lead-time  delivery.  These  and 
other  factors  have  resulted  in  an  information  processing  cost  distribution 
of  70%  for  software  and  30%  for  hardware  in  many  large  Air  Force  programs." 

In  the  next  section  (Section  IV-C-2),  we  shall  discuss  developments 
that  permit  constructive  approaches  to  a  better  matching  of  the  hardware 
and  the  problems  to  be  solved.  For  the  moment,  we  confine  our  discussion 
to  reducing  costs  and  improving  reliability  in  the  conventional  approach 
to  development  of  military  digital  data-processing  software. 

There  appear  to  be  seven  principal  sources  of  excess  cost  in  software 
development  for  tactical  data-processing  systems: 

1.  Selecting  hardware  and  starting  programming  before  the  system  is 
designed  in  detail — that  is,  before  the  system  functions,  organi¬ 
zation,  inputs,  outputs,  and  transfer  functions  are  thoroughly 
defined.  The  flexibility  of  the  digital  computer  is  used  as  an 
excuse  to  procrastinate  in  system  design. 

2.  Overburdening  the  central  processor  with  tasks  that  can  be  accom¬ 
plished  by  specialized  peripherals. 

3.  Selecting  too  small  a  central  processor,  with  consequent  over¬ 
utilization  of  the  computer  and  resort  to  bad  programming  prac¬ 
tices. 

4.  Program  overintegration,  which  makes  changes  difficult. 

5.  Lack  of  adequate  discipline  in  software  development. 
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6.  Developing  a  new  high-level  programming  language  for  every  job. 

7.  Starting  programming  before  the  computer  design  is  complete. 

The  importance  of  completing  system  design  in  detail  before  starting 
coding  is  well  recognized  by  data-processing  software  experts.  Intermix¬ 
ing  these  two  aspects  of  system  development  leads  to  uncertainty,  confu¬ 
sion,  rewriting,  and  patching  of  large  blocks  of  code.  Naturally,  were 
dedicated,  special-purpose  devices  used,  this  problem  would  be  <;  lleviated 
at  the  outset,  because  the  algorithms  to  be  mechanized  must  be  thought  out 
in  detail  before  the  hardware  can  be  built.  Where  general-purpose  comput¬ 
ing  is  employed,  the  same  processes  should  be  thought  out  completely  and 
specified  in  detail  before  coding  starts. 

There  is  a  tendency  to  reserve  all  difficult  processing  functions 
in  a  tactical  system  for  accomplishment  in  a  central  digital  computer 
because  "it  can  do  anything."  Besides  deferring  the  design  of  impor¬ 
tant  functional  elements  of  the  system,  this  syndrome  causes  the  aggre¬ 
gation  of  problems  to  an  extent  that  can  be  overwhelming  to  programmers, 
with  the  result  that  more  computing  capacity  may  be  needed  than  is 
available.  Further,  when  diverse  functions  are  mixed  in  a  single  ma¬ 
chine,  there  is  likely  to  be  competition  by  these  functional  elements 
for  priority  attention.  Isolating  functions  that  can  be  accomplished 
elsewhere  and  providing  peripheral  dedicated  special-  or  general- 
purpose  devices  to  perform  these  functions  can  greatly  ease  the  soft¬ 
ware  problem. 

As  utilization  of  the  capacity  of  a  general-purpose  computer  ap¬ 
proaches  100  percent,  the  programming  problem  becomes  increasingly  diffi¬ 
cult.  To  squeeze  the  program  down  so  that  it  will  fit  within  available 
storage-space  or  computing- time  restrictions  requires  tightening  the  cod¬ 
ing  and  perhaps  using  questionable  tricks  to  shorten  the  program  and 
minimize  the  use  of  core.  This  process  is  very  costly  of  coding  effort 
(Fig.  IV-5).  It  is  much  preferable,  from  the  standpoint  of  cost  tradeoffs, 
to  provide  a  computer  of  about  50  percent  excess  capacity,  so  that  the 
program  can  be  decomposed  and  written  in  well-defined  modules  that  are 
highly  independent  of  each  other  and  not  overly  integrated.^'*'  Program 
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overintegration  is  a  natural  tendency  of  programmers,  in  any  case,  and  it 
has  the  serious  fault  that  the  insertion  of  needed  changes  characteris¬ 
tically  reverberates  throughout  the  program,  inducing  many  further  changes 
and  more  cost. 

Strict  discipline  of  programming  operations  has  only  recently  been 
recognized  as  a  necessity  if  costs  are  to  be  controlled  and  program  errors 
are  to  be  minimized.  The  kind  of  discipline  imposed  is  analogous  to  that 
traditionally  employed  in  hardware  development.  ’’Structured  programming” 
is  one  such  disciplined  approach.  Specifically,  a  program  can  be  visual¬ 
ized  as  a  pyramid  with  control  programs  at  its  apex  and  functional  sub¬ 
routines  at  its  base.  Structured  programming  uses  the  "top-down ’’  approach, 
in  which  the  effort  starts  with  programmers  laying  down  the  executive  con¬ 
trol  system  and  specifying  the  blocks  of  program  required  in  the  next 
lower  layers.  The  work  progresses  down,  from  layer  to  layer,  with  func¬ 
tional  routines  specified  in  early  phases  but  not  actually  coded  until  the 
base  is  reached.  The  main  constraint  imposed  on  program  writing  is  the 
elimination  of  the  unconditional  transfer  (”go-to"  instruction),  which 
has  the  unfortunate  property  of  referring  to  a  part  of  the  program  over 
which  the  programmer  has  no  control. 

The  invention  of  new  or  modified  high-level  languages  in  vrfiich  to 
program,  in  the  interest  of  "efficiency,"  has  the  unfortunate  effect  of 
destabilizing  a  system  that  is  already  only  conditionally  stable.  New 
compilers  must  be  evolved  and  verified;  already  developed  routines  that 
might  have  been  conveniently  transferred  from  existing  program  libraries 
become  unusable. 

Initiation  of  programming  before  the  computer  design  is  complete  is 
clearly  wasteful,  because  even  minor  machine  changes  may  require  extensive 
program  revision. 

a .  Findings 

•  Software  costs  have  exceeded  hardware  costs  by  large  factors  in 
some  military  systems  using  general-purpose  computers.  Boehm,  of 
the  Rand  Corporation,  reported  that  the  Air  Force  in  1972  expended 
between  $1  billion  and  $1.5  billion  on  software  (that  is,  computer 
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programs  and  associated  documentation) — more  than  twice  its  ex¬ 
penditures  on  computer  hardware. 

•  Software  developments  are  frequently  behind  schedule,  causing 
other  costs  to  spiral. 

•  Software  "unreliability”  is  a  euphemism  for  software  errors. 

•  The  complexity  and  extent  of  the  software  may  well  be  a  measure  of 
the  mismatch  between  the  hardware  and  the  problem;  conversely,  by 
properly  designing  and  structuring  the  processor,  the  software 
problem  can  be  mitigated. 

•  The  major  sources  of  excessive  software  costs  in  conventioral 
systems  employing  central  uniprocessors  are  the  following: 

1.  Selecting  hardware  and  starting  programming  before  the  system 
is  designed  in  detail — that  is,  before  the  system  functions, 
organization,  inputs,  outputs,  and  transfer  functions  are 
thoroughly  defined.  The  flexibility  of  the  digital  computer 
is  used  as  an  excuse  to  procrastinate  in  system  design. 

2.  Overburdening  the  central  processor  with  tasks  that  can  be 
accomplished  by  specialized  peripherals. 

3.  Selecting  too  snail  a  central  processor,  with  consequent  over¬ 
utilization  of  the  computer  and  resort  to  bad  programming 
practices. 

4.  Program  overintegration,  which  makes  changes  difficult. 

5.  Lack  of  adequate  discipline  in  software  development. 

6.  Developing  a  new  high-level  programming  language  for  every  job. 

7.  Starting  programming  before  the  computer  design  is  complete. 

b.  Recommendations.  To  reduce  costs  of  software  in  processors 
employing  conventional  general-purpose  machines,  our  recommendations  are: 
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***  Complete  the  design  of  the  system  and  the  basic  program  struc¬ 
ture  in  substantial  detail  before  making  major  commitments  to 
hardware  or  coding. 

irk  Limit  the  aggregation  of  problems  to  be  solved  on  a  central 

machine;  as  an  alternative,  decentralize  processing  bv  providing 
peripheral  special-purpose  devices  (either  analog  or  digital)  or 
separate  peripheral  general-purpose  machines  to  perform  specific 
separable  functions. 

★★  Select  a  processor  of  adequate  size  to  permit  underutilizing  the 
computer;  write  highly  modular  programs;  emphasize  structure  and 
overall  efficiency  rather  than  hardware  efficiency  alone. 

Use  rigorous  discipline  in  software  development,  such  as  the 
top-down  Structured- Programming  approach. 

krk  Use  a  standard  well-established  programming  language  with  which 
programmers  are  thoroughly  familiar.  Use  the  highest  level 
language  appropriate  to  the  task  at  hand,  but  avoid  the  unneces¬ 
sary  development  of  a  unique  language. 

*k  Defer  coding  until  the  computer  design  is  substantially  complete 
and  firm,  except  for  that  necessary  to  verify  hardware- software 
design  compatibility. 

2.  Digital  System  Architecture 

Quoting  Turn,^  "Rapid  advances  in  semiconductor  components  and  pack¬ 
aging  have  increased  logic-circuit  and  memory  speed  as  well  as  reliability; 
at  the  same  time,  they  have  reduced  size,  weight,  and  power  requirements. 
Quantity  production  of  large-scale  integrated  (LSI)  circuits  and  medium- 
scale  integrated  (MSI)  circuits  not  only  promises  a  cost  reduction  but 
also  makes  it  economically  feasible  to  produce  computer  systems  having  a 
variety  of  architectures.  These  new  architectures  can  increase  computing 
speeds  several  orders  of  nagnitude  over  the  conventio.  al  uniprocessor .  At 
the  same  time,  it  has  become  feasible  to  use  hardware  t  provide  additional 


kirk  Highest  priority;  high  priority;  ★  priority. 


304 


built-in  features  such  as  microprogrammed  control,  data  management  in¬ 
structions,  hardwired  elementary  function  execution,  and  sophisticated 
look-ahead  capability. . .Hardware  architectural  features  could  be  and  are 
expected  to  significantly  improve  the  complex  software  problems  that  beset 
the  present  CC  data-processing  systems.  For  example,  floating-point 
arithmetic,  provided  by  programming  in  many  of  the  contemporary  airborne 
ar.d  spaceborne  computers,  can  be  expected  to  be  hardwired  into  all  future 
CC  computers.  Other  utility,  support,  and  operating  system  routines  that 
can  be  expected  to  be  mechanized  by  hardware  include  the  compiler,  com- 
partmentation  procedures  for  data  security,  and  executive  and  operating 
systems . " 

2  7 

Beum  and  Levin  predict  "the  use  of  hardware  to  perform  traditional 
software  functions  through  the  use  of  random  logic  nets  in  LSI  hardware 
for  floating-point  arithmetic,  multiply  and  divide,  square  root,  fast 
Fourier  transform,  priority  coding-decoding,  and  coordinate  transforma¬ 
tion;  table  look-up  implemented  in  ROM  for  multiply-divide ,  code  conver¬ 
sion,  BCD  arithmetic,  character  generation  for  displays,  trigonometric 
functions,  transducer  calibration,  etc.  ;  ar.d  microprocessors  (off-the- 
shelf  LSI  components  providing  a  library  of  hardware  subroutines)  to  be 
used  for  memory  paging,  vector  multiply,  fast  Fourier  reprocessing, 
digital  filtering,  output  formatting,  etc." 

27 

The  following  hypothesis  is  offered  by  Beum  and  Levin:  "By  1980 

digital  information  processing  hardware,  based  on  LSI  technology,  will  be 

available  at  very  low  cost.  For  all  practical  purposes,  it  will  be 
32 

free."~  Beum  and  Levin  state  the  airborne-processing  implications  of 
this  hypothesis  as  follows: 

1.  The  use  of  a  distributed  hierarchy  of  dedicated  processors  con¬ 
taining  both  logic  and  memory  where  the  emphasis  is  on  functional 
independence  rather  than  on  efficient  use  of  storage,  CPU,  I/O 
and  concerns  of  weight,  size,  and  power.  System  throughput  will 
be  achieved  by  simultaneous  operation  of  many  simple  processors 
rather  than  resource  sharing  in  a  few  high  performance  proc¬ 
essors.  . . . 

2.  The  minimization  and/or  elimination  of  airborne  software  through 
the  extensive  use  of  firmware  in  read  only  memories  with  internal 
logic  such  as  "CAMS,"  "stacks,"  and  "queues."  This  does  not 


305 


infer  the  elimination  of  the  ’’software  problem,"  the  need  for 
improved  software  production  standards  and  techniques.  Software 
development  will  remain  a  najor  part  of  the  development  cycle. 
Conversion  of  software  to  firmware  and  hardware  will  be  a  design 
goal  and  implemented  as  part  of  the  incremental  test  and  integra¬ 
tion  process  on  the  "hot- test- bed. " 

3.  The  incorporation  of  fault  detection,  internal  failure  diagnos¬ 
tics,  and  redundancy  of  each  hierarchical  level  along  with 
"state"  reporting  and  recording  to  support  naintenance  actions. 
This  capability  will  increase  reliability  and  system  effective¬ 
ness  and  involve  only  minimal  cost  in  dollars,  weight,  space  or 
power  utilization.* 

4.  Life-cycle  system  costs  and  total  defense  budget  dollar  savings 
would  be  achieved  through  the  availability  of  dedicated  informa¬ 
tion  processors  compatible  with  standard  interface  and  communica¬ 
tions  requirements.  This  would  also  alleviate  retrofit  and  re¬ 
configuration  problems  and  would  permit  common  elements  (sensors, 
displays,  actuators,  data  bases,  processors,  and  the  like)  to  be 
used  for  various  missions  and  in  different  vehicles. 

With  the  cost  of  data -processing  hardware--logical  and  storage  ele¬ 
ments-  -steadily  declining,  while  the  cost  of  software  increases,  the 
automatic  assumption  that  a  single,  central,  conventional,  general-purpose, 
programmable  uniprocessor  is  the  appropriate  choice  for  tactical  systems 
requires  re-examination.  In  earlier  times,  size,  weight,  and  cost  of  com¬ 
puting  machinery  demanded  that  logical  and  storage  elements  be  tine-shared 
under  program  control  so  that  they  could  be  efficiently  and  economically 
used.  Continuing  this  approach  with  larger  and  faster  machines  in  an 
epoch  of  high  programming  labor  costs  can  be  expected  to  lead  to  more  ex¬ 
tensive,  costly,  and  unreliable  software.  In  contrast,  the  advent  of 
large-scale  integration,  by  which  complex  algorithms  together  with  memory 
can  be  implemented  in  hardware  on  a  single  chip,  makes  it  possible,  with  a 
minimal  sacrifice  of  size,  weight,  or  cost,  to  assemble  dedicated  devices 
to  perform  separately,  on  a  full-time  basis,  functions  that  have  hereto¬ 
fore  been  time-shared  on  a  general-purpose  machine.  A  large  part  of  the 
software,  that  associated  with  interrupts  and  the  programmed  time-sharing 
of  logical  and  arithmetic  elements,  can  thus  simply  be  eliminated  through 
planned  "inefficiency"  in  the  application  of  hardware. 


*This  assertion  by  Beum  and  Levin  is  disputed  by  those  who  counter  that  the 
added  complexity  of  internal  failure  diagnostics  may  cause  an  overall  re¬ 
duction  in  reliability. 
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The  hardware  architecture  envisioned  by  Beum  and  Levin  as  an  excel¬ 
lent  match  to  the  avionics  data-processing  problem  is  essentially  a  three- 
level  hierarchy  of  independent,  dedicated  processors,  as  shown  in  Fig. 
IV-6.  At  the  lowest  level,  processors  are  operating  on  sensor  outputs 
to  deliver  predigested  data  to  the  next  level,  the  " functional”  proc¬ 
essor.  The  functional  processor  combines  and  correlates  data  from  sen¬ 
sors — for  example,  in  an  aircraft,  the  several  sources  of  navigation 
data,  including  inertial  measurement  unit,  doppler  navigator,  LORAN, 
VOR/DME  radio  altimeter,  and  air  data.  Another  functional  processor 
might  be  dedicated  to  operate  on  the  preprocessed  sensor  outputs  for 
fire-control  purposes.  Finally,  at  the  highest  level  of  the  hierarchy 
is  a  processor  that  monitors  system  operation,  keeps  diagnostic  records, 
and  provides  to  functional  processors  from  main  memory  the  data  required 
for  their  ope rat ion- -for  example,  latitude,  longitude,  and  channel  of 
nearby  VORTAC  stations,  and  ammunition  status  and  ballistic  data  on  re¬ 
maining  weapons  (Fig.  IV- 7).  The  reverse  information  flow  in  the  hier¬ 
archy  provides,  at  the  lowest  level,  signals  to  actuators  and  displays. 

28 

According  to  Williman  and  O'Donnell,  "Having  special-purpose  proc¬ 
essors  associated  with  the  sensors  offers  advantages  in  minimizing  the 
communication  bit  rate,  in  reducing  interrupts  and  overhead  in  the  central 
processor,  and  in  having  one  subcontractor  responsible  for  the  sensor 
mechanization  and  software  associated  with  the  sensor.  The  subcontractor 
can  thus  integrate  the  hardware  and  software  on  a  subsystem  level.  Ihis 
can  decrease  the  system  contractor's  programming  and  system- integration 
effort."  The  structure  described  is  a  variation  of  what  is  sometimes 
known  as  "federated"  architecture,  in  which  computers  operate  independ¬ 
ently.  The  dedicated  processors  may  be  either  mic reprogrammable  general- 
purpose  machines  or  special-purpose  machines.  The  data  buses  conveying 
information  between  sensor /actuator  and  functional  computers  are  standard¬ 
ized  as  to  speed  and  format,  as  are  the  data  buses  between  functional  com¬ 
puters  and  the  monitor  level. 

The  kind  of  standardization  that  rakes  sense  in  such  a  structure  is 
on  three  levels.  On  the  first  level  is  the  formation  of  a  library  of 
standard  LSI  processing  elements,  comprising  algorithms  and  memory,  from 
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which  processors  can  be  synthesized.  Such  a  library  is  just  beginning  to 
evolve  as  a  result  of  commercial  pressures. 
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•SPP  -  SPECIAL  PURPOSE  HARDWIRED  PROCESSOR  EMBEDDED  IN  SENSOR/ACTUATOR  HARDWARE. 


FIGURE  IV-7.  Projected  Avionic  Information  System  Architecture 


On  the  second  level  is  the  form-fit-f unction  standardization,  dis¬ 
cussed  earlier,  that  permits  interchange  of  competitive  units  of  different 
manufacture. 

On  the  third  level  is  the  standardization,  across  Service  lines  and 
for  a  diversity  of  applications,  of  data- interchange  speeds  and  formats  for 
multiplexed  digital  communication  among  sensors,  actuators,  processors, 
controls,  and  displays. 

An  adequate  library  of  standard  LSI  processing  elements  can  permit  the 
structuring  of  processors  specific  to  the  problem  to  be  solved.  One  ex¬ 
ample  is  the  associative  array  processor,  which  appears  to  have  extensive 
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application  to  large-volume  military  tactical  information  storage,  re¬ 
trieval,  processing,  and  data  distribution  systems.  An  associative  proc¬ 
essor  is  a  single- instruct  ion- stream,  multiple-data-stream  structure,  in 
which  each  word  in  the  associative  memory  unit  has  its  own  usually  simple 
serial  processing  unit.3*"*  Processing  operations  are  performed  concur¬ 
rently  by  all  these  processing  units.  Logic  is  included  as  an  integral 
part  of  each  bit  of  each  word  of  memory,  permitting  simultaneous  compari¬ 
son  of  the  data  stored  in  each  word  with  a  reference  word.  Thus,  memory 
searches  can  be  performed  at  high  speed  on  all  words  or  on  specified  sub¬ 
sets  of  the  memory.  Such  memory  systems  can  be  characterized  as  "content 
addressable.”  An  important  characteristic  is  that  lists  can  be  carried 
in  memory  in  any  order. 

Easy  storage  and  rapid  search  and  retrieval  are  not  the  only  signi¬ 
ficant  characteristics  of  the  associative  array  processor.  Hie  ability  to 
concurrently  add,  multiply,  or  divide  one  array  by  another,  or  to  perform 
logical  comparisons  gives  the  associative  array  processor  enormous  speed 
advantages  over  the  conventional  uniprocessor  in  many  tasks--for  example, 
air  traffic  control.33  It  is  not  clear  that  standard  programming  lan¬ 
guages  are  directly  applicable  to  the  associative  array  processor. 

The  foregoing  represent  just  two  examples  of  how  the  evolution  of 
highly  complex  LSI  processing  elements  can  make  possible  the  development 
of  digital  processing  hardware  that  is  better  matched  to  the  problems  to 
be  solved.  It  must  be  pointed  out,  though,  that  a  better  match  can  be 
achieved  even  without  the  use  of  advanced  microcircuit  technology  by  a 
careful  and  methodical  total-system  design. 

a.  Findings 

•  No  current  basis  exists  for  the  common  assumption  that  conven¬ 
tional  centralized  programmable  uniprocessors  are  the  most  effec¬ 
tive  or  most  economical  bases  on  which  to  strucrure  military 
tactical  data  systems. 

•  The  cost  of  programming  is  escalating,  while  the  cost  of  standard 
computing  hardware  is  plummeting;  a  new  look  is  needed  at  the 
balance  between  hardware  and  software  in  system  architecture. 
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•  The  advent  of  large-scale  integration  has  led  to  the  cheap  and 
plentiful  implementation  in  hardware,  on  single  chips,  of  stand¬ 
ardized  complex  algorithms  together  with  memory.  With  hardware 
implementation  of  a  complex  algorithm,  the  need  for  writing  the 
algorithm  in  software  is  eliminated. 

•  There  is  a  growing  library  of  these  hardware- implemented,  standard 
complex  computing  functions  that  makes  possible  the  synthesis  of 
specialized  processing  units  and  the  elimination  of  much  of  ^he 
software.  The  low  cost  and  snail  size  of  these  units  mitigate  che 
need  for  time-sharing  their  use,  and  permit  distributed  process¬ 
ing,  federated  architectures,  associative  array  processing,  and 
processing  structures  specifically  tailored  to  system  functions. 

b.  Recommendations .  The  principal  need  in  data-processing  system 
design  is  a  reversion  to  the  engineer’s  approach  of  first  analyzing  the 
problem,  then  laying  out  alternate  solutions,  and  then  choosing  and  pursu¬ 
ing  the  most  effective  and  economical.  Specifically, 

System-function-oriented  processing-hardware  structures  should 
be  considered  as  alternatives  to  the  conventional  centralized 
programmable  uniprocessor  for  use  in  military  tactical  systems. 

The  military  processing  problem  should  be  clearly  stated;  the 
system  design  should  be  spelled  out  in  detail;  and  alternate 
processor  architectures  and  designs  should  be  compared  before  a 
hardware  approach  is  selected. 

A  processor  design  for  each  system  should  be  selected  and  de¬ 
veloped  that  will  minimize  the  combined  costs  of  hardware  and 
software;  the  allocation  of  functions  between  hardware,  soft¬ 
ware,  and  hunen  operators  should  be  consciously  worked  out  prior 
to  decision. 

★*  Standard  LSI  processing  elements  available  from  more  than  one 
source  should  be  used  to  the  maximum  extent  possible;  devel- 
_ opment  of  uniquely  military  LSI  elements  should  be  minimized. 

Highest  priority;  irk  high  priority;  ★  priority. 
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**  Military  laboratories  should  be  encouraged  to  investigate  and 
develop  processor  architectures,  including  federated  architec¬ 
tures,  that  fit  military  problems  and  are  cost-effective.  Con¬ 
versely,  their  extensive  efforts  in  the  programming  of  conven¬ 
tional  uniprocessors  should  be  reduced  to  bring  the  overall 
program  into  better  balance. 

*★  Commercially  successful  processors  for  which  software  already 
exists  should  be  considered  for  DOD  applications  vdierever 
appropriate. 

★*  Formats  and  speeds  for  data  interchange  among  sensors,  actuators, 
processors,  controls,  and  displays  should  be  standardized  across 
Service  lines  and  for  as  wide  a  variety  of  applications  as  prac¬ 
ticable. 


★★★  Highest  priority;  ★★  high  priority;  *  priority. 
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D.  DESIGN  EVOLUTION  AND  CONFIGURATION  MANAGEMENT34 

Department  of  Defense  Directive  5010.19  and  Instruction  5010.21, 
together  with  DOD  Standard  MIL-STD-480,  now  govern  configuration  man¬ 
agement.  A  new  Department  of  Defense  regulation,  "Configuration  Man¬ 
agement,"  is  in  the  last  stages  of  signoff  prior  to  official  promulga¬ 
tion.3’’  It  will,  when  finally  approved  and  issued,  establish  revised 
policies  and  practices  applicable  to  all  segments  of  DOD. 

The  purposes  of  configuration  management  appear  to  be  six:3*3 

1.  To  ensure  that,  once  approved,  a  design  does  not  deteriorate 
by  reason  of  the  unilateral  introduction  by  a  contractor  of 
inadvisable  changes. 

2.  To  maintain  specified  form- fit- function  characteristics  of 
equipment  unless  there  are  compelling  reasons  for  change. 

3.  To  avoid  changes  that  increase  cost  and  delay  delivery. 

4.  To  ensure  that  internal  equipment  changes  that  may  affect 
interchangeability  and  installation  provisions  are  recognized 
and  acted  upon. 

5.  To  ensure  review  of  safety-related  changes,  such  as  aircraft 
weight,  balance,  or  flight  safety  . 

6.  To  carefully  document  successive  equipment  configurations  for 
purposes  of  maintenance  and  to  facilitate  competitive  re- 
procurement. 

The  central  aspect  of  configuration  management  is  that  certain 
types  of  change  must  be  reviewed  and  approved  by  the  Government  before 
they  are  undertaken.  The  central  philosophy  of  requiring  Government 
approval  of  proposed  changes  is  to  protect  the  Government’s  interests; 
thus,  the  philosophy  is  basically  defensive.  The  questions  that 
subsequent  paragraphs  of  this  section  seek  to  examine  are: 

1.  Are  Government  configuration  management  policies  consistent 
with  the  freedom  needed  by  a  supplier-warrantor  to  make  the 
evolutionary  internal  design  changes  he  sees  as  needed  to 


increase  reliability,  thus  to  balance  the  costs  of  production 
and  maintenance,  both  of  which  he  is  responsible  for? 

2.  Are  Government  configuration  management  practices  appropriate 
— that  is,  expeditious  enough — to  permit  timely  incorpora¬ 
tion  of  changes  in  electronic  equipment  that  are  needed  to 
correct  deficiencies  in  reliability  or  in  other  performance? 

3.  Are  Government  configuration  management  policies  consistent 
with  design-to-cost  contracting,  in  which  the  developer  is 
ostensibly  free  to  adjust  the  performance  of  equipment  under 
development  to  match  the  target  production  price? 

4.  Are  Government  configuration  management  policies  flexible 
enough  to  permit  design  evolution  within  a  form -fit -function 
specification  framework  intended  to  encourage  continuing 
design  and  price  competition  among  interchangeable  designs? 

The  about -to-be -promulgated  DOD  regulation  covering  configuration 
management  will  be  taken  as  authoritative  and  representing  the  intended 
updating  of  current  DOD  policies.  Current  practices,  on  the  other 
hand,  have  been  the  subject  of  specific  investigation  by  W.J.  Douglas 

of  Ketron,  Inc.,  and  are  reported  in  Electronics-X  Subcontractor  Re- 

.  .  34 

port  4. 

One  important  clause  from  the  forthcoming  DOD  regulation  deserves 
special  scrutiny: 

3-2.  Change  criteria.  Engineering  changes,  waivers,  or 
deviations  affecting  the  Government’s  interest  in  the  con¬ 
figuration  of  a  Cl  (Configuration  Item)  will  be  limited  to 
those  which  are  necessary  or  offer  significant  benefit  to 
the  Government.  (Underscoring  ours) 

This  clause  illustrates  a  fundamental  bias  in  that  it  excludes  from 
consideration  changes,  waivers,  or  deviations  that  benefit  the  con¬ 
tractor  but  are  neither  beneficial,  disadvantageous,  nor  necessary  to 
the  Government.  Such  a  situation  could  be  expected  to  arise  in  the 
case  of  a  fixed -price  supplier  and  long-term  warrantor  who  found  chat 
changes  in  internal  configuration  of  an  electronic  equipment  would 
substantially  lower  the  cost  of  building  and  maintaining  it. 
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Incorporating  such  a  change  would,  of  course,  be  desirable  from  the 
supplier-warrantor’s  standpoint,  since  it  would  reduce  his  cost  and 
increase  his  profit.  It  could  be  neither  beneficial,  disadvantageous, 
nor  necessary  to  the  Government,  since  the  supplier-warrantor  would 
already  be  under  contract  to  supply  and  maintain  the  equipment  for  a 
long  term  under  a  fixed-price  agreement.  Thus,  the  clause  provides 
in  certain  projected  situations  a  disincentive  to  contractors  to 
evolve  less  costly,  easier-to-maintain  designs  through  design  simpli¬ 
fication  or  the  application  of  new  technology. 

If  the  contractor  were  able  to  demonstrate  that  the  changed 
equipment  would  be  more  reliable  in  military  use,  or  if  the  contractor 
offered  to  share  the  projected  cost  reduction  with  the  Government,  a 
benefit  to  the  Government  would  exist,  and  the  change,  waiver,  or 
deviation  could  be  considered.  However,  requiring  such  a  demonstra¬ 
tion  of  Government  benefit,  we  believe,  puts  an  undue  burden  on  the 
contractor*  and  reduces  his  incentive  to  evolve  improved  designs. 

We  believe,  therefore,  that  the  clause  should  be  changed  to  read: 

3-2.  Change  Criteria.  Engineering  changes,  waivers,  or 
deviations  in  the  configuration  of  a  Cl  will  be  limited 
to  those  which  are  necessary,  or  offer  significant  benefit 
to  the  Government,  or  are  substantially  beneficial  to  the 
contractor  and  not  prejudicial  to  the  interests  of  the 
Government. 

Changes  are  classified  by  MIL-STD-480.  Class  I  changes  are  nomi¬ 
nally  defined  as  those  that  affect  form,  fit,  function,  price,  delivery, 
safety,  or  support,  while  others  are  Class  II.  Yet,  from  Fig.  1  of 
the  about-to-be -promulgated  DOD  regulation,  a  product  baseline  is  es¬ 
tablished  at  the  end  of  full-scale  development  and  test  of  prototype 
items,  and  from  Paragraph  3-3  of  the  same  source, 

Once  the  product  baseline  is  established,  all  changes 
to  an  item  down  to  its  lowest  reparable  level  shall 
be  processed  as  Class  I.  (Underscoring  ours) 


*A  tixed-price  supplier  or  warrantor  has  undertaken  considerable  risk, 
his  price  has  been  established  competitively,  and  he  should  not  be 
required  to  share  the  fruits  of  his  cost-reduction  effort. 
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The  significance  of  this  is  that  all  changes  to  items  for  which  a 
product  baseline  is  established,  not  just  important  changes,  must  be 
processed  as  Class  I,  which  means  that  they  must  undergo  th<=  full  Gov¬ 
ernment  engineering -change-proposal  (ECP)  approval  process  before  being 
implemented.  In  contrast,  when  a  change  is  classified  as  Class  II  (a 
decision  that  can  be  confirmed  by  the  Government  plant  representatives 
at  the  contractor's  plant),  this  lengthy  and  costly  submission,  review, 
and  approval  process  should  be  avoided. 

The  problem  is  in  the  timeliness  of  Service  processing  of  Class  I 
change  actions.  Although  the  proposed  configuration  management  regu¬ 
lation  meticulously  enunciates  a  policy  of  promptness,  in  actual  prac¬ 
tice  the  time  required  to  implement  a  change  via  the  ECP  process  tan 
vary  over  a  wide  range.  The  approximate  magnitude  of  this  time  period 
can  be  established  by  examining  some  of  the  data  made  available  for 
this  study. 

In  1970,  the  GAO  examined  the  delay  being  experienced  in  proces- 
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sing  ECPs  throughout  the  Services.  Table  IV-5  shows  data  extracted 
from  a  sample  of  547  ECPs.  The  results  indicate  that  81  percent  of 
all  ECPs  required  mere  than  the  DOD  standard  of  45  days  to  process. 

The  GAO  study  further  showed  that  sequential  processing  and  procedures 
having  ill -defined  milestones  were  largely  responsible  for  tne  delays. 
The  ECPs  were  not  being  internally  tracked.  The  major  effect  of  the 
delay  is  the  increased  cost  of  implementing  in  the  field  changes  thac 
could  have  been  caugnt  on  the  production  line  by  expeditious  process¬ 
ing  of  the  ECPs. 

The  Services  have  taken  steps  to  improve  the  processing  of  ECPs. 
Recent  modifications  to  the  configuration  management  manuals  of  the 
Services  have  defined  milestones  from  receipt  of  ECP  up  through  con¬ 
tract  agreement.  In  the  Army  Electronics  Command  at  Fort  Monmouth, 
detailed  ECP  statistical  data  are  maintained  in  the  Production  and 
Procurement  Directorate.  An  analysis  of  the  data  has  indicated  that 
over  70  percent  of  the  ECPs  are  processed  within  45  days.  However, 
when  contractual  action  is  required,  some  6  or  7  months  elapse  between 
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ECP  approval  and  the  initiation  of  a  contract  to  actually  accomplish 
the  approved  change.  This  time  is  taken  up  in  the  process  of  procure* 
ment,  which  involves  submission  of  a  detailed  proposal,  contract  nego¬ 
tiations,  and  the  issuance  of  a  contract  modification. 

TABLE  IV-5.  ECP  DELAY3 


Agency 


Number 

of 

ECPs 

Sampled 


Percentage  Distribution 


Average  ‘ - 

Duration  of  46-  91-  181- 

Processing,  s  45  90  180  360  >360 

days  Days  Days  Days  Days  Days 


Naval  Air  Systems 

292 

158 

9% 

21% 

39% 

26% 

5% 

Command 

Army  Aviation 

180 

103 

27 

24 

34 

15 

0 

Systems  Command 
Aeronautical  Sys¬ 

75 

92 

37 

32 

19 

9 

3 

tems  Division, 

Air  Force  Sys¬ 
tems  Command 

Overall 

547 

131 

19% 

24% 

34% 

20% 

3% 

NOTE:  Overall,  processing  time  for  81  percent  of  the  ECPs  exceeds  the 
DOD  standard  of  45  days. 

MIL- STD-481  (Configuration  Control):  45  days  for  routine  ECP 

15  days  for  urgent  ECP 
1  day  for  emergency  ap¬ 
proval 


Source:  Ref.  37. 


For  another  view  of  the  ECP  process,  the  ECP  files  at  the  Naval 
Air  Systems  Command  (NAVAIR)  were  consulted.  At  NAVAIR,  the  program 
manager  decides  within  5  days  whether  or  not  to  pursue  che  ECP.  At 
this  time,  a  Change  Control  Board  (CCB)  change  request  is  completed, 
in  which  information  from  the  ECP  is  aggregated  for  use  by  the  CCB 
on  NAVAIR  Form  13050/2.  NAVAIR  further  breaks  out  the  CCB  request 
forms  by  contractor  so  that  the  contractors  for  electronic  and 
avionic  systems  can  be  looked  at  separately.  A  group  of  over  100 


CCB  electronics  and  avionics  change  requests  acted  upon  during  FY 
1972  were  examined.  Of  these,  84  produced  usable  data. 

The  average  processing  time  for  these  ECPs  is  shown  in  Table 
IV-6.  The  breakdown  is  given  according  to  three  categories: 

1.  Production  changes 

2.  Production  and  retrofit  changes 

3.  Retrofit  changes. 

The  results  in  Table  IV-6  indicate  a  long  delay,  particularly 
for  changes  involving  cost  increases.  For  no-cost  ECPs,  the  delay 
varies  from  1.6  to  2  times  the  45-day  target.  For  cost-increase 
ECPs,  the  delay  varies  from  2.4  to  4.2  times  the  45-day  target. 

TABLE  IV-6.  PROCESSING  TIME  FOR  ECPs  AT  NAVAL  AIR  SYSTEMS 
COMMAND,  FY  1972 


Number  of  Average  Processing 
Changes  Time,  days 


Production  Changes 


Cost  Increase 

No  Cost 

Production  and  Retrofit  Changes 

10 

6 

122 

92 

Cost  Increase 

12 

190 

No  Cost 

30 

74 

Retrofit  Changes 

Cost  Increase 

26 

106 

No  Cost 

-- 

— 

It  is  difficult  to  conclude,  on  the  basis  of  these  observations, 
whether  the  ECP  approval  process  is  dilatory  or  excessively  detailed, 
since  the  complexities  surrounding  the  changes  were  not  amenable  to 
investigation  within  the  time  available  for  this  study.  It  is  clear, 
however,  that  the  average  time  required  for  approval  is  excessive 
from  the  standpoint  of  realizing  the  benefits  of  a  change  as  early  as 
possible  in  the  course  of  production.  The  delays  are,  of  course, 
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compounded  when  the  change  originates  with  a  lower-tier  subcontractor 
and  must  be  processed  through  the  hierarchy. 

Past  experience  indicates  that  the  configuration  of  electronic 
equipment  at  the  end  of  full-scale  development  (that  is,  at  the  start 
of  production)  has  simply  not  received  enough  cumulative  testing  to 

38 

ensure  adequate  field  reliability.  It  has  been  demonstrated  further 
that  reliability  growth  slows  drastically  when  the  freedom  to  incorpo¬ 
rate  corrective  changes  is  sharply  restricted.  Thus,  the  clause  pre¬ 
viously  quoted  from  Paragraph  3-3  of  the  regulation  exerts  an  impeding 
effect  on  reliability  growth  by  requiring  recourse  to  a  lengthy  ECP 
approval  process  just  at  the  time  when  equipment  appears  in  the  field 
and  operational  use  is  beginning  to  expose  the  equipment’s  previously 
hidden  deficiencies. 

The  clause  is  evidently  based  on  the  premise  that  the  Government 
is  to  perform  equipment  repair,  since  it  refers  to  ’’changes. .  .down  to 
...lowest  reparable  level,”  and  the  object  is  apparently  to  avoid, 
impede,  or  expose  changes  that  would  require  revision  of  stocks  of 
repair  parts  established  by  the  Government.  Clearly,  therefore,  it 
is  inappropriate  to  the  situation  in  which  a  supplier-warrantor  has 
undertaken  responsibility  for  maintaining  equipment  and,  accordingly, 
should  have  as  much  freedom  as  possible  to  reconfigure  the  equipment 
internally  to  improve  its  reliability  and  cut  maintenance  costs. 
Moreover,  the  clause  is  a  serious  disincentive  to  reliability  growth, 
regardless  of  who  is  responsible  for  equipment  repair. 

In  order  to  encourage  reliability  improvement  and  to  avoid  delays 
in  putting  re liability -oriented  changes  into  effect,  we  prefer  the  use 
of  two  baselines  for  electronic  equipment:  a  tentative  product  base¬ 
line  ,  established  at  the  end  of  full-scale  development,  and  a  final 
product  baseline,  established  by  the  Government  after  field-reliability 
objectives  have  been  attained  or  at  such  other  time  as  the  Government 
believes  that  further  internal  configuration  changes  should  be  dis¬ 
couraged.  The  second  and  third  sentences  of  Paragraph  3-3  should,  we 
believe,  be  replaced  by  the  following: 
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An  engineering  change  to  a  privately  developed  item 
or  to  an  item  for  which  a  tentative  product  base¬ 
line  has  been  established  shall  be  classified  Class 
I  when  it  affects  form,  fit,  function,  safety,  or 
increases  cost  or  delivery  schedule  of  the  item; 
otherwise  it  shall  be  classified  Class  I.  Once 
the  final  product  baseline  is  established,  all 
changes  to  an  item  down  to  its  lowest  reparable 
level  shall  be  processed  as  Class  I. 

Were  this  change  made,  definitions  of  tentative  and  final  product 
baseline  configurations  would  be  needed  in  Chapter  2  of  the  proposed 
regulation  on  configuration  management.  To  establish  a  tentative 
product  baseline  when  full-scale  development  is  completed  and  produc¬ 
tion  is  begun,  and  to  defer  establishing  the  final  product  baseline 
until  field  experience  has  been  obtained  (or  until  the  Government 
wishes  to  take  over  equipment  maintenance  from  a  long-term  contrac¬ 
tor);  a  contract  would  state  the  dates  or  conditions  upon  which  the 
two  baselines  would  become  effective.  The  flexibility  to  do  so  is 
already  provided  in  the  proposed  regulation  (Paragraph  l-2d).  The 
change  proposed  here  would  have  no  effect  on  the  requirements  for 
maintaining  configuration  documentation  and  records.  It  would  be 
appropriate  for  the  Government,  of  course,  to  defer  procurement  of  a 
full  stock  of  spare  parts  until  the  final  product  configuration  had 
evolved . 

Paragraph  l-5a(3)  of  the  proposed  regulation  states: 

CIs,  during  Full  Scale  Development,  will  be  sub¬ 
jected  to  configuration  management,  principally 
at  the  system/prime  item  level  as  defined  in 
MIL-STD-490 . 

This  requirement  for  configuration  management  appears  to  be  in¬ 
consistent  with  the  flexibility  needed  in  design-to-cost  development 
contracts.  As  discussed  in  Section  III-B,  the  object  of  design-to- 
cost  development  is  to  achieve  by  iterative  adjustment  the  best  pos¬ 
sible  match  of  requirements,  developed  product,  and  target  production 
cost.  To  accomplish  this  end,  a  minimal  imposition  of  formalism  on 
communication  between  contractor  and  Government  is  d  sirable, 
articularly  as  regards  engineering  changes.  We  therefore  believe  that, 
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even  though  the  regulation  contains  words  indicating  need  for  flexi¬ 
bility  in  application  of  the  configuration  management  process,  the 
following  sentence  should  be  added  to  Paragraph  l-5a(3): 

Exception:  Items  in  the  process  of  full-scale 
development  under  design-to-cost  contracts  will 
not  be  subject  to  formal  configuration  manage¬ 
ment  procedures  except  to  the  extent  specifically 
called  out  by  contract. 

The  proposed  regulation  on  configuration  management  appears  to 
be  consistent  with  the  application  of  form-fit-function  specification 
and  interface  standardization.  The  regulation  also  appears  to  be  con¬ 
sistent  with  the  policies  and  practices,  proposed  elsewhere  in  this 
report,  of  periodic  design  improvement,  block  changes,  and  continuing 
design  competition  between  similar  designs. 

1.  Findings 

•  A  new  DOD  regulation,  ”Conf iguration  Management,”  is  in  the 
last  stages  of  signoff  prior  to  official  promulgation.  It 
will  establish  policies  and  practices  applicable  tD  all 
segments  of  DOD.  As  it  now  stands,  this  draft  regulation 
still  has  the  following  drawbacks: 

1.  Ic  unduly  restricts  the  freedom  required  by  a  supplier- 
warrantor  to  make  the  evolutionary  internal  design 
changes  he  sees  as  needed  to  increase  reliability  and 
thus  to  decrease  the  sum  of  unit  production  cost  plus 
unit  contractor  maintenance  warranty  cost. 

2.  It  imposes  a  configuration  baseline  at  the  end  of  full- 
scale  development.  Thus,  all  changes  after  this  point  — 
and  experience  shows  there  are  many — must  undergo  the 
formal  configuration-change  processing  routine,  a  rou¬ 
tine  that  has  often  led  to  delays  in  the  past  despite 
good  intentions  and  reasonable  procedures. 

3.  Its  effect  would  be  to  restrict  the  freedom  required  to 
make  tradeoffs  between  cost,  performance,  schedule,  and 
quantity  in  design-to-cost  contracts. 
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•  The  draft  regulation  properly  emphasizes  the  requirements 
for  meticulous  configuration-status  accounting  and  keeping 
technical  documentation  current  with  the  configuration. 

2 .  Recommendations 

The  about -to-be-promulgated  DOD  regulation  on  configuration 
management  should  be  adopted  with  the  following  modifica¬ 
tions: 

1.  It  should  specifically  permit  consideration  of  changes 
that  are  of  benefit  to  the  contractor  and  not  detrimen¬ 
tal  to  the  Government. 

2.  It  should  establish  two  product  baselines,  the  first  a 
"tentative”  one  at  the  end  of  full-scale  development, 
and  the  second,  "final"  one  when  the  design  has  been 
adequately  stabilized  ( see  below) . 

3.  It  should  permit  internal  equipment  changes  that  do  not 
affect  form,  fit  (compatibility  and  interfaces), 
function,  price,  or  delivery  to  be  classified  Class  II 
(as  defined  in  the  regulation)  in  order  to  facilitate 
the  change  approval  process  until  the  "final”  product 
baseline  is  invoked  by  the  Government. 

irlrtr  The  Government  should  defer  invocation  of  the  final  product 
baseline,  as  applicable  to  electronic  equipment,  until  field 
reliability  objectives  have  been  achieved,  or,  in  the  case 
of  equipment  under  contract  maintenance  warranty,  until  the 
warranty  period  is  about  to  end  and  the  Government  is  about 
to  take  over  maintenance  from  the  warrantor. 

The  Government  should  defer  full  spares  stocking  until  after 
the  final  product  baseline  is  invoked. 


Highest  priority;  high  priority;  *  priority. 
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E.  PROJECT  MANAGEMENT 

Never  tell  people  how  to  do  things. 

Tell  them  what  to  do  and  they  will 
surprise  you  with  their  ingenuity . 

-- George  Smith  Patton ,  Jr. 

As  a  result  of  findings  by  Electronics-X  teams  that  insufficient  data 
were  available  to  permit  the  setting  of  firm  cost  targets  for  design- to- 
cost  (DTC)  projects,  it  was  concluded  that  tradeoffs  between  performance, 
cost,  schedule,  and  quantity  had  to  be  made  throughout  the  RDTf.E  phase  of 
a  DTC  program,  and  only  at  the  end  of  the  RDTEE  phase  could  the  unit  pro¬ 
duction  cost  be  set  in  binding  contractual  terms.  During  the  production 
phase,  a  modicum  of  flexibility  is  still  required  so  that  tradeoffs  be¬ 
tween  performance,  schedule,  and  quantity  can  be  made  as  the  program 
progresses  (Section  III-C).  This  raises  the  question  whether  the  project 
manager  (PM)  can  be  expected  to  make  the  required  tradeoffs. 

To  answer  this  question,  we  have  briefly  reviewed  project  management, 
as  applied  to  electronic  subsystems,  through  discussions  with  managers  and 
staffs  of  21  project  offices:  12  Navy,  6  Air  Force,  and  3  Army  (Table 
IV- 7 ) .  Despite  the  unequal  representation  of  the  different  Services  in 
these  discussions,  we  believe  our  review  has  attained  a  reasonable  balance 
of  the  views  of  the  Services. 

The  major  emphasis  of  the  discussions  was  on  the  ability  of  the  proj¬ 
ect  manager  to  make  practical  tradeoffs  between  cost,  schedule,  and  per¬ 
formance  (including  reliability,  availability,  and  maintainability) ,  and 
usually  included  the  following  issues: 

-  Project  manager’s  authority  versus  his  responsibility 

-  Tradeoff  capabilities  and  limitations 

-  Practical  significance  of  project  manager’s  rank 

-  Selection  of  project  office  personnel 

-  Career  opportunities  in  project  management 

-  Levels  of  management  between  project  manager  and  Service  Secretary 


TABLE  IV- 7.  PROJECT  MANAGEMENT  OFFICES  VISI1ED  DURING  STUDY 
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Demand  for  briefings  by  project  manager 

-  Organization  of  project  office. 

The  results  of  this  brief  review  are  reported  fully  in  Ref.  39  and  are 
summarized  below. 

In  general,  there  are  four  types  of  project  managers: 

1.  Project  managers  for  major  systems  that  are  primarily  electronic 
(Class  I*  electronics) 

2.  Project  managers  for  major  systems  of  which  electronics  forms  an 
important  subsystem  (Class  II*  electronics) 

3.  Project  managers  for  single  electronic  subsystems  (Class  II  or 
III*  electronics) 

4.  Multiprogram  project  managers  ("basket”  PMs),  who  manage  a  number 
of  similar  or  related  electronic  subsystems  (Class  III  elec¬ 
tronics). 

Project  managers  for  major  weapons  systems  such  as  the  F-14  must 
usually  adhere  to  rigid  development  schedules  imposed  by  important  system 
components  other  than  electronics--the  airframe,  for  example.  Project 
managers  for  major  systems  have  considerable  clout  on  the  one  hand  and 
great  visibility  on  the  other.  Errors  are  highly  visible  and  subsystem 
modifications  are  discouraged,  since  they  might  cause  costly  slips  in 
overall  schedules.  Long-term  commitments  are  required,  and  overall  sys¬ 
tem  schedules  permit  little  change  in  electronic  subsystem  configurations 
if  they  affect  interfaces  with  other  parts  of  major  systems.  A  project 
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Class 

I: 

Class 

II: 

Class 

III: 

Class 

IV: 

Major 


cs  as  defined  in  Section  III-B-4: 
systems,  by  DSARC  criteria,  50  percent  or  more  of 
whose  cost  is  in  electronics. 

Electronic  subsystems  of  major  (DSARC)  systems,  represent¬ 
ing  10  percent  or  more  of  total  system  cost,  and  included 
within  and  scheduled  with  the  major  system  acquisition. 
Electronic  subsystems,  multipurpose  in  character,  de¬ 
veloped  independently  for  use  in  many  major  systems,  and 
themselves  below  the  criteria  for  major  systems. 

Other  electronic  systems  and  devices,  below  DSARC  cri¬ 
teria,  that  do  not  fall  into  any  of  the  above  categories. 
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manager  for  a  major  weapons  system  often  prefers  a  firm  and  unchanging 

specification  for  an  electronic  subsystem  unless  changes  in  that  subsystem 

are  required  by  and  essential  to  the  weapons  system.  Thus,  continuing 

tradeoffs  that  might  improve  an  electronic  subsystem  are  less  important 

than  the  availability  of  a  set  of  electronic  subsystems  to  choose  from 

whose  costs  and  interface  characteristics  are  firmly  established.  x 

Subsystem  project  managers  are  of  lower  rank  and  have  lower  visi¬ 
bility  but  somewhat  greater  rlexibility  than  major-system  project  managers. 

One  of  their  main  problems,  because  of  the  limited  life  of  their  projects, 
is  getting  and  keeping  good  personnel.  This  can  affect  their  capability 
for  making  tradeoffs,  even  if  the  authority  to  do  so  is  granted  them. 

The  multiprogram  project  manager  runs  a  perpetual  project  office  that 
nanages  the  development  of  a  whole  series  of  related  equipments  or  sub¬ 
systems.  Such  a  project  manager  is  usually  of  high  rank,  often  a  briga¬ 
dier  general  or  rear  admiral.  At  any  one  time,  some  of  the  subsystems  for 
which  his  project  office  is  responsible  are  entering  production,  others 
are  in  engineering  development,  while  still  others  are  in  advanced  develop¬ 
ment.  The  permanence  of  the  office  allows  it  to  attract  and  keep  good 
personnel.  Schedules  are  somewhat  flexible,  encouraging  some  degree  of 
innovation.  But  if  two  programs  reach  a  crisis  stage  simultaneously,  the 
top  man  is  often  saturated  and  may  have  to  shortchange  one  program  to  fur¬ 
ther  another. 

Tradeoff  possibilities  in  all  project  offices  are  limited  by: 

-  Formalized  restrictions  in  the  governing  documents  on  reprogram¬ 
ming  funds  or  changing  major  specifications. 

-  The  origin  of  the  funding  (often,  each  subsystem  has  a  different 
sponsor) 

-  Limitations  imposed  by  the  project  manager’s  commander  (such  as 
the  Army  Materiel  Command  limit  of  $200,000  on  the  funds  that 
may  be  shifted  from  one  program  to  another) . 

The  most  flexible  and  apparently  effective  arrangement  we  saw  during  our 
series  of  interviews  involved  a  multiprogram  project  office  where  the 
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project  manager  had  the  authority  to  reprogram  about  15  percent  of  his 
total  annual  DT&E  funds  among  his  various  programs.  His  high  rank,  his 
forceful  personality,  and  the  fact  that  he  had  a  single  "sponsor"  were 
probably  responsible  for  his  unusually  flexible  position. 

The  need  for  quick  reprogramming  of  funds  from  one  program  to  another 
by  the  project  manager  is  greatest  when  tradeoffs  between  cost,  perform¬ 
ance,  reliability,  and  schedule  must  be  made  at  frequent  intervals.  The 
need  is  most  evident  during  the  DT&E  phase  and  persists  in  the  OT&E  and 
the  LRIP  phases.  Once  the  unit  production  cost  is  set  as  part  of  a  pro¬ 
duction  contract,  the  need  for  reprogramming  of  dollars  by  the  project 
manager  disappears,  but  freedom  for  the  PM  to  make  limited  tradeoffs  among 
the  other  parameters  while  holding  unit  production  cost  constant  remains 
essential. 

Some  project  managers  indicated  that  they  had  participated  in  the 
formulation  of  original  program  requirements.  Not  surprisingly,  those 
project  managers  generally  were  enthusiastic  about  the  requirements,  had 
confidence  in  their  legitimacy,  and  felt  able  to  complete  the  programs 
successfully. 

1.  Finding 

•  Design  to  cost  is  a  concept  which  depends  for  its  success  on  the 
flexibility  and  timeliness  of  management  decisions.  Such  deci¬ 
sions  are  usually  best  made  at  the  project- manager  level,  provided 
that  the  project  manager  has  the  requisite  authority--for  example, 
sufficient  authority  to  shift  funds  from  one  program  to  another  in 
a  multiprogram  project  office,  and  thus  to  defer  or  eliminate 
lower  priority  tasks  in  one  program  in  order  to  expedite  high- 
priority  tasks  in  another  program.  This  reprogramming  authority 
is  present  in  some  multiprogram  offices  but  is  abst-nt  in  others, 
largely  because  different  line  items  in  the  budget  are  often  con¬ 
trolled  by  different  "sponsors"  in  the  headquarters  organization, 
and  each  sponsor  guards  his  share  of  the  budget. 
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2.  Recommendations 
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**★  Use  the  multiprogram  project  office  ("basket”  SPO)  structure 

for  all  independent  electronic  subsystem  development  where  a  x 

number  of  related  or  similar  developments  can  be  grouped  under 
one  perpetual  project  manager  (PM)  to  provide  a  PM  of  higher 
rank  and  greater  authority,  better  project  office  personnel, 
more  responsive  support  from  functional  groups,  and  more  trade¬ 
off  flexibility. 

*+*  Provide  multiprogram  project  offices  with  sufficient  flexi¬ 
bility  in  the  use  of  available  RSD  funds  to  allow  the  necessary- 
tradeoffs  by  the  PM  in  the  development,  OT&E,  and  LRIP  phases. 

★*  Arrange  for  the  project  manager  or  prospective  project  manager 
to  participate  in  drafting  the  operational  requirements  before 
developing  specifications  for  subsystems  under  his  jurisdiction. 

**  Make  available  to  system  project  managers  catalogs  of  available 
electronic  equipment  that  show  current  price  and  reliability 
figures  as  well  as  technical  descriptions. 


Highest  priority;  ★★  high  priority;  ★  priority. 
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F.  DATA  COSTS40 

Significant  quantities  of  technical  data  are  acquired  and  paid  for 
by  DOD  each  year.  Estimates  range  from  $1.5  to  $2.25  billion  annually  for 
contractually  required  data  items,  including  those  for  electronics.  This 
is  the  formal  cost  charged  by  contractors  for  data  and  does  not  include 
the  Government's  cost  associated  with  requesting,  receiving,  reviewing, 
handling,  or  storing  technical  data.  Contractor  and  Government  personnel 
indicate  that  additional  costs  for  data  items  are  charged  under  other 
headings  to  contractor  direct  labor  and  are  not  explicitly  included  in 
the  data  costs  as  called  out  contractually.  In  subsequent  paragraphs,  the 
cost  of  data  associated  with  electronics  acquisition  will  be  estimated, 
che  major  reasons  for  obtaining  the  data  will  be  indicated,  and  approaches 
to  reducing  data  costs  will  be  recommended. 
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To  provide  the  basis  for  the  observations  that  follow,  discussions 

were  held  with  Army,  Navy,  and  Air  Force  representatives  involved  in  data 

nanagement,  three  electronic  equipment  contractors  were  interviewed  about 

41 

technical  data,  and  the  Air  Force  Data  Review  Action  Group  (DRAG)  Study, 
which  in  1970  examined  the  data  requirements  of  28  major  Air  Force  pro¬ 
grams,  was  reviewed  and  evaluated.  Particular  attention  was  paid  to  the 
details  of  four  primarily  electronics  programs  covered  in  the  Air  Force 
study.  In  addition,  nine  proposals  and  contracts  (five  Army,  two  Navy, 
and  two  Air  Force)  were  evaluated  for  technical-data  cost. 

1.  Data  Costs  as  a  Percentage  of  Program  Costs 

The  Air  Force  DRAG  Study  examined  all  data  items  on  the  Contract  Data 
Requirements  List  (DD  Form  1423).  The  purpose  was  to  eliminate  data  items, 
refer  them  to  higher  authority  for  deletion  or  modification,  and  modify 
(the  frequency  or  number  of  copies  of)  existing  data  requirements.  The 
total  cost  of  each  of  the  four  electronics  programs  reviewed  by  the  DRAG 
Study  was  more  than  $22  million,  the  data  costs  ranging  from  1.1  percent 
to  16  percent  of  program  cost.  The  total  data  cost  for  these  four  pro¬ 
grams  was  $13.2  million.  The  DRAG  Study  recommended  changes  that  could 
potentially  reduce  data  costs  by  16  percent.  It  was  later  found  that,  in 
fact,  a  saving  of  only  1  percent  in  data  cost  was  realized  on  these  four 
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programs,  primarily  because  the  Study's  recommendations  came  too  late  to  ^ 

accomplish  reductions  in  the  data  required  under  contract.  Nevertheless, 
by  highlighting  and  categorizing  data  costs,  the  DRAG  Study  was  of  utility. 

Evaluation  of  contracts  and  proposals  revealed  considerable  variation 
in  data  cost  from  program  to  program.  It  was  noted  that  for  small  RDT&E 

^  X. 

contracts  of  $1  million  or  less,  formal  data  cost  constituted  approxi¬ 
mately  20  percent  of  contract  cost.  Review  of  Army  Electronics  Command 
(AECOM)  information  indicated  that  97  percent  of  AECOM  awards  were  for 
less  than  $1  million,  which  accounted  for  approximately  46  percent  of  the 
dollars.  It  was  concluded  that  the  ratio  of  data  cost  to  program  cost  for 
all  RDT&E  programs  averages  approximately  10  percent.  This  ratio  was 
estimated  to  be  5  percent  for  production  contracts. 

2.  Data  Costs,  Categories,  and  Content 

The  cost  of  data  for  electronic  equipment  was  estimated  as  follows . 

The  formal  cost  of  all  data  is  $1.5-$2.25  billion  annually,  of  which 
electronics  data  are  estimated  at  approximately  33  percent  of  the  sum, 
or  $0.5  billion  to  $0.75  billion.  Alternatively,  estimating  electronics 
data  at  10  percent  of  the  $2.9  bilJion  contracted  RDT&E  cost  and  5  per¬ 
cent  of  the  $5.6  billion  production  cost  yields  a  cost  of  $0.57  billion 
annually  for  electronics  data.  This  last  figure  is  used  to  estimate 
the  costs  of  various  electronics  data  categories. 

Data  can  be  categorized  by  the  use  to  vtfiich  it  is  put.  The  al¬ 
location  of  electronics  data  costs  among  these  categories  was  found  to 
be  as  follows: 

-  Re procurement :  15  percent  or  $85.5  million 

-  Engineering  Validation  and  Monitoring:  30  percent  or  $171  million 

-  Maintenance  and  Training:  50  percent  or  $285  million 

-  Administrative  and  Cost  Control:  5  percent  or  $28.5  million. 

Typical  contractor  data  items  included  in  each  category  are  as 
follows : 
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-  Reprocurement :  Drawings  and  specifications 

-  Engineering  Validation  and  Monitoring:  Reliability  and  maintain¬ 
ability  documentation,  test  plans  and  reports,  component  selection 
reports 

-  Maintenance  and  Training:  Technical  manuals,  maintenance  manuals, 
operating  nanuals,  provisioning  documentation 

-  Administrative  and  Cost  Control:  PERT  charts,  contract  status 
line  of  balance  reports. 

The  largest  single  data  cost  was  found  to  be  for  handbooks  and  tech¬ 
nical  manuals.  The  DRAG  Study  indicated  handbook  cost  to  be  53  percent  of 
total  data  cost  for  all  kinds  of  equipment  programs  studied.  For  elec¬ 
tronic  equipment  programs  only,  cost  of  technical  manuals  was  35-50  per¬ 
cent  of  total  data  cost. 

3.  Data  Requirements  Generation  and  Validity 


Determination  of  requirements  for  the  data  to  be  supplied  under  con¬ 
tract  characteristically  starts  with  a  request--a  "data  call"--issued  by 
the  Government  program  manager.  Individual  specialists  in  support  activ¬ 
ities  of  the  development  agencies  then  state  their  needs  and  specifica¬ 
tions  for  configuration-management  plans,  handbooks,  reliability  docu¬ 
mentation,  human- factors  engineering  documentation,  drawings,  electro¬ 
magnetic  compatibility  analysis,  progress  reports,  cost  reports,  and  so  on. 
The  aggregated  requirements  are  then  sometimes  (not  invariably)  examined 
by  a  Data  Requirements  Review  Board,  which  can  add  or  subtract  items  but 
seldom  provides  a  stringent  review. 

t 

Because  the  attitude  on  data  is  "better  to  have  it  and  not  need  it 
than  to  need  it  and  not  have  it,"  the  Contract  Data  Requirements  List 
often  turns  out  to  be  far  more  extensive  than  is  warranted.  A  recent  re¬ 
quest  for  quotations  for  design-to-cost  development  of  a  relatively  simple 
electronic  item  [Army  absolute  altimeter  AN/APN-209  (Section  III-C)] 
listed  70  required  data  items,  including  such  items  as  a  radioactive- 
material  report,  a  maintainability  rrathematical  model,  and  five  nuclear- 
vulnerability  test  plans  and  reports. 
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The  net  effect  of  such  massive  reporting  requirements  can  be  counter¬ 
productive.  Recognizing  that  Government  review  of  submitted  data  must  be 
less  than  thorough  because  of  the  enormous  volume  submitted,  a  simple 
solution  for  a  contractor  is  to  hire  hack  specialists  to  prepare,  with  the 
least  possible  expenditure  of  effort,  time,  bother,  and  diversion  from  the 
main  work,  voluminous  and  plausible-sounding  documents  whose  relationship 
to  the  actual  project  effort  is  not,  and  probably  cannot  be,  validated  by 
the  Government  specialist  who  reviews  them. 

It  is  our  conclusion  that  the  submission  of  massive  amounts  of 
written  information  cannot  substitute  for  direct  oral  discussions  among 
interested  parties  and  for  laboratory  testing  and  measurement  of  equipment 
to  determine  whether  its  properties  meet  military  requirements.  The  in¬ 
creasing  efforts  to  make  such  substitutions  appear  to  further  the  erection 
of  a  communications  barrier  between  Government  and  contractor  as  though, 
somehow,  this  were  a  necessary  concomitant  of  an  arms-length  relationship. 
Moreover,  a  sluggish  mass  of  written  communications  is  incompatible  with 
the  speed  and  flexibility  required  in  design-to-cost  development  and  is, 
as  indicated  earlier,  extremely  costly. 

4.  Potential  Data  Cost  Savings 

Four  observations  have  been  made  by  Government  and  contractor  per¬ 
sonnel  with  regard  to  contractually  required  data: 

1.  There  is  limited  availability  of  DOD  personnel  to  review  data 
items  submitted  for  review. 

2.  Documentation  must  be  submitted  too  early  to  be  valid. 

3.  Many  data  items  overlap. 

4.  Data  are  required  that  have  low  probable  utility. 

On  the  basis  of  Air  Force  studies  and  our  own  observations,  we  be¬ 
lieve  that  data  costs  could  be  reduced  by  at  least  10  percent,  with  a 
resultant  saving  of  $60  million,  by  eliminating  dubious  data  requirements, 
by  deferring  data  procurement  until  the  need  is  firmly  established,  by 
relying  to  a  greater  extent  on  commercial  formats,  and  by  deferring  the 
required  delivery  of  provisioning  data  and  technical  manuals  until  the 
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equipment  design  has  been  stabilized.  Were  all  of  the  Electronics- X 
recommendations  implemented,  the  reduction  in  data  requirements  might 
amount  to  as  much  as  50  percent,  or  $275  million. 

5.  Findings  and  Recommendations 

a .  Findings 

•  The  cost  of  electronics  technical  data  to  DOD  is  very  large.  It 
consists  of  the  following:  an  estimated  annual  $600  million  for¬ 
mally  charged  for  data;  hidden  costs  charged  under  the  headings 
of  "engineering"  or  other  categories  of  direct  labor;  and  Govern¬ 
ment  costs  entailed  in  requesting,  receiving,  reviewing,  handling, 
or  storing  technical  data.  On  the  average,  the  formal  cost  of 
data  averages  about  10  percent  of  RDT&E  contract  costs  and  5  per¬ 
cent  of  production  costs. 

•  The  largest  cost  items  are  handbooks  and  technical  manuals,  which 
comprise  some  35-50  percent  of  the  total  data  costs  for  elec¬ 
tronics. 

•  The  data  requirements  are  so  massive  that  it  is  impossible  for 
Government  personnel  to  review  the  submitted  material  or  to  test 
its  validity. 

•  Discussions  with  industry  representatives  show  that  the  reprocure¬ 
ment  data  submitted  in  response  to  contract  requirements  are  not 
the  data  used  for  actual  manufacture  in  the  contractor's  plant; 
the  plant  may  use  numerical  control  tapes,  while  the  Government 
data  may  consist  of  exquisite  india  ink  drawings  on  mylar. 

•  The  submission  of  the  data  is  often  required  too  early  to  be  valid. 
For  example,  handbooks  and  provisioning  documents  may  have  to  be 
submitted  before  the  equipment  design  is  stabilized. 

•  Many  of  the  data  items  required  overlap. 

In  addition  to  these  observations  on  the  current  course  of  events,  it 
is  pertinent  to  note  that,  were  certain  of  the  recommendations  of  other 
sections  of  this  report  to  be  followed,  some  conventional  data  require¬ 
ments  would  be  reduced  or  eliminated. 
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equipment  design  has  been  stabilized.  Were  all  of  the  Electronics-X 
recommendations  implemented,  the  reduction  in  data  requirements  might 
amount  to  as  much  as  50  percent,  or  $275  million. 

5.  Findings  and  Recommendations 

a .  Findings 

•  The  cost  of  electronics  technical  data  to  DOD  is  very  large.  It 
consists  of  the  following:  an  estimated  annual  $600  million  for¬ 
mally  charged  for  data;  hidden  costs  charged  under  the  headings 
of  "engineering"  or  other  categories  of  direct  labor;  and  Govern¬ 
ment  costs  entailed  in  requesting,  receiving,  reviewing,  handling, 
or  storing  technical  data.  On  the  average,  the  formal  cost  of 
data  averages  about  10  percent  of  RDT&E  contract  costs  and  5  per¬ 
cent  of  production  costs. 

•  The  largest  cost  items  are  handbooks  and  technical  manuals,  which 
comprise  some  35-50  percent  of  the  total  data  costs  for  elec¬ 
tronics. 

•  The  data  requirements  are  so  massive  that  it  is  impossible  for 
Government  personnel  to  review  the  submitted  material  or  to  test 
its  validity. 

•  Discussions  with  industry  representatives  show  that  the  reprocure¬ 
ment  data  submitted  in  response  to  contract  requirements  are  not 
the  data  used  for  actual  manufacture  in  the  contractor’s  plant; 
the  plant  may  use  numerical  control  tapes,  while  the  Government 
data  may  consist  of  exquisite  india  ink  drawings  on  mylar. 

•  The  submission  of  the  data  is  often  required  too  early  to  be  valid. 
For  example,  handbooks  and  provisioning  documents  may  have  to  be 
submitted  before  the  equipment  design  is  stabilized. 

•  Many  of  the  data  items  required  overlap. 

In  addition  to  these  observations  on  the  current  course  of  events,  it 
is  pertinent  to  note  that,  were  certain  of  the  recommendations  of  other 
sections  of  this  report  to  be  followed,  some  conventional  data  require¬ 
ments  would  be  reduced  or  eliminated. 

333 


1.  Were  competitive  equipments  available  from  two  or  more  suppliers, 
the  need  for  reprocurement  data  would  be  eliminated. 

2.  If  direct  transfer  of  information  from  developer  to  second-source 
supplier  were  encouraged  by  suitable  incentives,  the  reprocure¬ 
ment  data  package  could  be  reduced  in  extent  and  less  rigid  in 
format. 

3.  If  equipments  were  repaired  by  contractors  under  warranty  or  by 
specialists  at  depots,  the  extensive  and  explicit  instructional 
documentation  required  for  organizational  repair  by  technicians 
of  limited  capability  could  be  reduced,  and  good  commercial- grade 
handbooks  would  suffice. 

4.  If  competitive  prototyping  and  test  were  the  bases  for  acceptance 
of  equipment  designs,  the  need  for  voluminous  in-process  valida¬ 
tion  data  would  be  reduced. 

b.  Rec  ommenda  t  ion  s 

★  Accept  contractor’s  data  format  unless  there  is  a  demonstrable 
advantage  in  specifying  a  Government  format.* 

★*  Defer  the  ordering  and  delivery  of  contractor  data  until  the 
need  is  firmly  established.* 

*★  Delay  procurement  of  spares  provisioning,  technical  manuals  and 
maintenance  handbooks  until  the  point  of  design  stabilization  is 
identified  and  reached.* 

Scrub  data  requirements  mercilessly  through  the  efforts  of  Data 
Requirements  Review  Boards  that  include  representation  of  the 
project  manager,  the  user,  and  industry. 

★  Where  the  equipment  future  is  uncertain,  buy  options  on  repro¬ 
curement  data  instead  of  the  data  itself. 


++*  Highest  priority;  irk  high  priority;  ★  priority. 

*Recommendation  also  rrede  by  Electronic  Industries  Association  and  con¬ 
tained  as  policy  in  DOD  Directive  5010. 29R,  "Data  Acquisition  Management 
Program,”  draft. 


334 


The  following  recommendations,  previously  made  in  other  contexts, 
have  been  recast  below  to  reflect  their  impact  on  data  costs  where  applic¬ 
able. 

•  Use  competing  suppliers  of  interchangeable  equipment  to  reduce 
the  need  for  reprocurement  data. 

•  Use  contractor  warranties  and  maintenance  to  reduce  the  need  for 
technical  and  maintenance  manuals  and  provisioning  data. 

•  Rely  on  competitive  prototyping  and  test  as  a  substitute  for 
voluminous  in-process  validation  data  (and  as  a  substitute  for 
myriad  detailed  specifications). 

•  As  an  alternative  to  formal  and  highly  detailed  reprocurement 
drawings  and  specifications,  require  less  formal  drawings  and 
encourage  more  informal  information  transfer.  For  reprocurement 
data,  pay  a  fixed  amount  for  the  drawings  plus  a  fixed  amount  for 
each  equipment  successfully  delivered  by  the  second  source. 
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G .  COST  ESTIMATION 


Much  of  the  uncertainty  exhibited  in  the  ability  of  DOD  to  estimate 

ultimate  product  or  program  costs  derives  from  the  cost-estimation  process 

42 

itself  and  the  methodology  available  to  the  estimator.  It  is  clear  from 
past  cost-estimating  experience  that  improvements  are  desperately  needed 
in  the  ability  to  estimate  the  future  cost  of  major  electronic  weapons 
systems  and  associated  electronic  subsystems.  As  a  first  step,  the  exist¬ 
ing  tools  available  for  cost  estimation  must  be  examined  to  determine 
their  strong  and  weak  points.  Then,  candidate  avenues  for  improvement  can 
be  addressed  to  improve  these  existing  estimating  tools.  Finally,  areas 
of  estimating  uncertainty  which  exist  independently  of  all  efforts  to  im¬ 
prove  estimating  methodology  must  be  identified  as  potential  limiting  con¬ 
straints  placed  upon  both  expected  cost  values  and  residual  levels  of  cost 
uncertainty. 

1.  Techniques  for  Electronics  Cost  Estimation 

The  tools  available  for  estimating  the  acquisition  and  operations 
cost  for  electronic  equipment  can  be  classified  into  four  broad  methodo¬ 
logical  categories :  engineering,  parametric,  analogy,  and  subjective. 

The  engineering  methodology  for  cost  estimation  consists  of  a  detailed 
’'bottom-up"  estimating  process  that  begins  with  the  assignment  of  cost 
elements  to  as  many  product  and  program  plan  details  as  can  be  defined  by 
the  estirrator.  Typically,  the  man-hour  and  material  requirements  to  de¬ 
sign,  develop,  produce,  and  maintain  a  system  are  identified  on  the  basis 
of  detailed  drawings  and  specifications  for  the  system  and  detailed  pro¬ 
gram  plans  for  its  acquisition  and  deployment.  Parametric  cost  estirrates 
are  made  by  first  determining  and  costing  causal  relationships  between 
physical  or  functional  characteristics  (parameters)  of  past  systems,  and 
then  comparing  the  parameters  of  a  new  system  to  these  past  relationships 
for  possible  extrapolation  or  interpolation  of  new-system  costs.  Statis¬ 
tical  analysis  of  historical  costs  and  parametric  variables  is  commonly 
used  to  develop  parametric  cost-estimating  relationships  for  systems  of 
particular  functional  types.  Cost  estimation  by  analogy  derives  costs  of 
new  programs  and  products  from  data  on  past  costs  of  similar  programs  or 
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products.  Frequently,  this  technique  involves  estimation  of  the  incre¬ 
mental  or  marginal  cost  associated  with  product  improvement  and  production. 
Finally,  subjective  or  judgmental  cost  estination  is  used  whenever  data 
are  not  available  on  similar  programs  or  products  and  when  large  areas  of 
undefined  effort  are  involved.  This  kind  of  estimation,  often  referred  to 
as  "engineering  judgment,”  attempts  to  synthesize  the  program  and  cost¬ 
estimating  experience  of  experts  and  to  apply  this  insight  to  new,  unde¬ 
fined  programs.  Each  of  these  estimating  tools  can  be  applied  with  vary¬ 
ing  degrees  of  success  during  the  electronic  system  life  cycle  as 
summarized  in  Table  IV-8. 

2 .  Application  of  Cost- Estimating  Methodologies 

The  successful  application  of  the  general  methodologies  described 
above  depends  critically  upon  the  positio:.  of  the  program  or  product  in 
the  acquisition  process.  While  expert  subjective  cost  estimates  based 
upon  past  experience  can  be  used  throughout  the  product  acquisition  cycle, 
other  cost-estimating  techniques  are  dependent  upon  information  developed 
as  a  component,  system,  or  weapon  proceeds  from  advanced  development  to 
production.  The  engineering  technique  of  cost  estimation  is  of  limited 
value  until  procedural  details  of  a  development  program  ran  be  specified 
and  general  concepts  and  characteristics  of  the  equipment  can  be  identi¬ 
fied.  Parametric  and  analog  cost  estimates  depend  heavily  upon  identifi¬ 
cation  of  characteristic  physical  or  functional  performance  variables 
and  the  general  technology  (e.g.,  discrete  semiconductor,  LSI,  digital, 
analog,  electromechanical)  for  a  new  system.  Often,  this  information  is 
not  realistically  known  until  preproduction  prototypes  have  been  built. 
Premature  application  of  these  techniques  can  be  heavily  biased  by  previ¬ 
ous  levels  of  technology  and  may  fail  to  account  for  rapid  technological 
advances,  as  well  as  discrepancies  between  planned  and  achieved  perform¬ 
ance.  The  rapid  technological  change  in  electronics,  relative  to  other 
equipments,  makes  this  factor  exceptionally  important  for  electronics  cost 
estimation. 

Even  when  a  new  product  reaches  the  production  stage,  considerable 
uncertainty  still  remains  about  the  eventual  outcome  of  the  production 
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program,  as  well  as  the  operational  performance  of  the  product.  Investi¬ 
gations  made  during  the  present  study  indicate  that  the  cost  uncertainties 
of  production  are  strongly  coupled  to  the  operational  performance  re¬ 
quired.  Engineering  changes  and  retrofit  costs  can  be  major  contribu¬ 
tors  to  production-cost  growth. 

Each  phase  of  the  acquisition  process,  therefor''  'ns  irany  un¬ 
knowns  that  impact  upon  the  accuracy  of  cost  estin.  hown  in 

Table  IV- 9,  these  unknowns  are  reduced  as  the  acquisition  ;ss  proceeds 
into  production,  but,  even  at  reprocurement,  several  major  areas  of  un¬ 
certainty  that  influence  cost-estimating  ability  continue  to  exist. 

3.  Problem  Areas  in  Cost  Estimation 

Key  problem  areas  that  constrain  attempts  to  improve  the  accuracy  of 
electronics  cost  estimates  are  electronics-cost  data  acquisition,  cost¬ 
estimating  methodologies,  and  rapid  technological  change.  Other  important 
influencing  factors,  such  as  economic  and  business  base-cost  projections, 
must  also  be  analyzed  in  an  effort  to  improve  the  resultant  cost  estimate. 
Improvements  in  these  areas  can  help  to  reduce  electronics  cost-estimating 
uncertainties  but  will  not  eliminate  them. 

The  study  found  that  one  of  the  most  common  problems  of  electronics 
cost  estimation  is  the  lack  of  accurate  cost  and  performance  data  on  pre¬ 
viously  developed  and  deployed  systems,  subsystems,  and  equipments.  In 
the  categories  of  research  and  development  and  procurement,  the  data  on  a 
wide  range  of  electronics  are  unavailable  to  analysts  because  of  the  sub¬ 
system  or  integral  nature  of  the  electronics.  Separate  units  of  military 
electronic  equipment  designated  by  AN/nomenclature  are  frequently  de¬ 
veloped  and  procured  by  prime  contracts;  therefore,  contract  cost  data 
should  be  available  for  historical  analysis.  However,  study  after  study 
has  discovered  that  historical  contract  records  are  frequently  incomplete, 
inconsistent,  and  lack  detailed  data  on  equipment  costs  during  the  produc- 
tion  phase.  Research  and  development  costs  are  also  difficult  to  obtain, 
even  when  contractual  information  is  available,  because  electronics  de¬ 
velopment  programs  typically  spawn  a  number  of  end-items.  Apportionment 
of  development  efforts  and  costs  to  one  specific  electronic  product  is 
often  a  matter  of  judgment  or  arbitrary  allocation.  Another  problem  that 
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TABLE  IV- 9.  COST- ESTIMATING  "KNOWNS"  AND  "UNKNOWNS”  AT  VARIOUS  STAGES  IN 
ACQUISITION  PROCESS,  ESTIMATING  TECHNIQUES,  AND  PROBABLE  ACCURACY 
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enters  into  analysis  of  procurement  and  development  contract  efforts  is 
the  fact  that  the  actual  cost  can  be  obtained  only  from  contracts  that 
are  cost- reimbursable.  Fixed-price  contracts  reflect  contractor  price  but 
not  incurred  cost.  S,uch  data  can  be  misleading  as  well  as  inaccurate  for 
cost-data  analysis. 

When  electronics  is  deployed  in  the  field,  the  cost  of  operations  and 
maintenance  activities  must  be  based  upon  data  furnished  by  the  reporting 
systems  of  the  Services.  However,  these  systems  are  presently  designed  to 
record  operational  maintenance  activities  (or  performance).  Except  for 
work  accomplished  at  tha  depot  level,  they  do  not  attempt  to  estimate 
actual  costs  incurred  during  maintenance  of  electronic  components.  To 
date,  the  total  operations  and  maintenance  cost,  which  includes  cost  of 
organizational  and  intermediate  maintenance,  is  not  available  from  Service 
accounting  systems.  A  key  part  of  the  life-cycle  costs  incurred  by  elec¬ 
tronics  must,  therefore,  be  estimated  rather  than  retrieved  from  histor¬ 
ical  data. 

A  second  major  problem  area  contributing  to  electronics  cost  uncer¬ 
tainty  is  the  methodology  available  to  the  estimator.  Cost-estimating 
methodology  must  have  good  cost  data  on  previous  systems  and  a  credible 
relationship  that  relates  past  costs  to  future  program  or  product  vari¬ 
ables.  Notwithstanding  the  poor  condition  of  the  data  base  as  discussed 
above,  the  state  of  the  art  of  cost-estimation  methodology  also  contains 
independent  weaknesses.  Because  of  the  rapid  advance  of  electronic  tech¬ 
nology,  there  has  yet  been  little  parametric  correlation  between  elec¬ 
tronic  product  performance  and  cost.*  Independent  parametric  cost  esti¬ 
mates  (IPCEs),  represented  as  an  important  DOD  tool  for  assessing  con¬ 
tractor  and  program-office  estimates,  have  been  weak  in  the  electronics 
area  because  of  the  paucity  of  valid  parametric  cost  relationships  and 
because  of  rapidly  changing  technology  and  costs.  Contractors  have 

attempted  to  construct  parametric  relationships  for  their  products  with 

44 

only  marginal  success.  When  they  need  accurate  cost  estimates,  they 
* 

The  successful  correlations  between  cost  and  perfornBnce  (or  physical 
characteristics)  have  been  so  sparse  that  they  have  become  isolated 
examples.  The  principal  successes  are  limited  to  sonars,  inertial 
navigation  platforms,  selected  radars,  and  military  spacecraft. 
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unanimously  turn  to  detailed  engineering-cost  estimates  constructed  from 

cost-activity  experience  on  previous  programs.  Applying  this  technique,  ^ 

the  contractors  are  in  reality  applying  parametric  costing  at  a  greater 

level  of  detail  and  building  up  the  total  estimate  from  component  parts.  x 

Their  success  in  using  this  technique  has  not  been  widely  documented,  but 

contractors  are  uniformly  convinced  that  the  engineering  estimate  is  the 

most  accurate. 

Use  of  industrial  engineering  estimating  techniques  has  been  extended 
to  DOD  in  a  limited  way  by  the  RCA  Corporation  through  the  contractual  use 
of  a  proprietary  computerized  model,  PRICE,  which  calculates  development 
and  production  costs  from  several  (more  than  50)  product  physical  and 
functional  variables  and  program  schedules.  This  system  contains  a  ter¬ 
minal-operated  capability  for  simulating  detailed  engineering  estimates 
and  producing  diagnostic  cost-sensitivity  analyses.  Investigations  of 
this  technique  indicate  that,  despite  the  limitations  in  software  estima¬ 
tion  and  RCA-oriented  costing  procedures,  the  PRICE  system  is  an  extremely 
useful  tool  for  independent  estimate  generation  based  upon  an  extensive 
industrial  data  base. 

In  almost  every  case  investigated,  various  cost-estimating  method¬ 
ologies  for  electronics  have  not  stood  the  test  of  empirical  verification 
by  long-run  program-cost  experience.  Thus,  there  is  little  indication 
that  the  electronics  cost-estimating  methodology  developed  in  recent  years 
has  improved  the  DOD  ability  to  predict  electronics  costs.  In  terms  of 
life-cycle  cost  estimates  including  operations  and  maintenance  costs,  the 
lack  of  actual  operational-cost  data  has  effectively  prevented  a  meaning¬ 
ful  test  of  the  various  detailed  and  complex  models.  The  universal  re¬ 
liance  of  these  models  upon  mean-time-between-failures  (MTBF)  and  mean- 
time-to-repair  (MTTR)  characteristics  of  the  equipment  is  also  noted. 

Failure  to  verify  or  confirm  the  costs  predicted  by  the  models  has  affect¬ 
ed  their  utility  so  that  application  of  the  models  to  comparative  analyses 
or  cost/ performance  tradeoffs  is  believed  to  be  narginal  for  most  types  of 
elec  tron ic  s  a  pp 1 ica  t ion  s . 

Other  problems  abound  in  the  area  of  electronics  cost  estimation. 

Very  little  effort  has  been  sponsored  to  improve  DOD’s  ability  to  estimate 
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the  impacts  of  schedule  changes  and  of  rapidly  advancing  electronics 
technology  program  cost,  the  effects  of  competition  and  the  influence  of 
micro-  and  nacro-economic  variables  on  electronics  acquisition,  and  the 
impact  of  a  policy  of  voluntary  armed  forces  on  electronics  maintenance 
costs.  Costs  of  computer  programming  and  other  software  design  and 
development  efforts  have  not  been  analyzed;  contract  estimates  differing 
by  an  order  of  magnitude  continue  to  be  submitted  for  similar  software 
tasks.  Finally,  only  recently  have  cost  estimates  of  electronic  weapons 
systems  and  equipment  been  made  that  illustrate  the  confidence  in  or  the 
prediction  intervals  of  the  estimates.  These  problem  areas  accompany 
estimates  of  the  expected  value  of  electronics  and,  perhaps  even  more 
important,  assessment  of  the  estimates  as  predictors  based  upon  the  input 
variables. 

3.  Findings  and  Recommendations 

a.  Findings 

•  A  variety  of  cost-estimating  tools  and  techniques  are  available 
for  electronics;  however,  their  development  and  application  to 
electronics  have  been  restricted  because  of  an  inability  to  ob¬ 
tain  appropriate  input  data. 

•  Parametric  estinetes  for  electronics  have  been  generally  inade¬ 
quate  to  predict  future  program  or  product  costs  accurately. 

This  is  attributed  to  failure  to  establish  cost/performance  causal 
relationships  for  the  equipment  and  to  rapidly  changing  technol¬ 
ogies  and  associated  costs. 

•  Computer-based  models  of  detailed  cost-estirating  procedures  at 
the  lowest  work  level  (such  as  the  RCA  PRICE  model)  have  been  used 
successfully  by  industry  for  reducing  estimating  uncertainty.  DOD 
use  of  these  estimating  techniques  through  contractor  or  in-house 
model  development  represents  a  promising  approach  to  improved  cost 
estimation. 

•  The  continued  development  of  electronics  cost-estinating  method¬ 
ologies  could  be  enhanced  by  establishing  repositories  for  elec¬ 
tronics  contract  data. 
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•  While  improvements  in  variable  cost  estimates  for  products  and 
programs  will  reduce  estimating  uncertainty  a  great  deal,  about 
30  percent  of  the  documented  program-cost  overruns  have  been 
attributed  to  economic  factors.  These  areas  of  cost  uncertainty 
(which  indirectly  affect  other  areas)  must  be  addressed  by  both 
Government  and  industry  if  big  improvements  in  electronics  cost 
estimation  are  to  be  expected. 

•  Improvements  in  estimates  of  life-cycle  or  ownership  costs  are 
being  retarded  because  of  the  lack  of  a  universal  cost-element 
definition  and  the  lack  of  knowledge  of  the  direct  and  indirect 
operating  costs  to  the  Government  that  are  appropriately  asso¬ 
ciated  with  specific  electronic  equipments,  subsystems,  and 
systems.  Identification  and  quantification  of  these  elements  are 
too  often  delegated  to  c^upeting  contractors  who  are  motivated  to 
select  those  factors  and  cost  elements  that  tend  to  show  their 
products  in  the  most  favorable  light. 

b.  Rec omme nda t i on s .  The  above  findings  lead  to  a  number  of  policy 
recommendations  for  DOD  in  the  area  of  electronics  acquisition  and  opera¬ 
tion.  The  policies  recommended  below  are  designed  to  yield  additional 
information  on  and  better  estimates  of  electronics  cost  during  the  product 
life  cycle.  However,  to  be  applied  with  maximum  benefit,  they  must  be 
implemented  at  the  lowest  and  most  effective  decisionmaking  level  within 
DOD  and  used  for  program/product  tradeoffs,  beginning  with  DSARC  I. 

•  DOD  should  strengthen  its  ability  to  independently  estimate  elec¬ 
tronics  acquisition  costs.  DOD  can  begin  this  task  by: 

Continuing  efforts  to  develop  parametric  cost-estimating  rela¬ 
tionships  for  major  electronic  systems  containing  a  limited 
number  of  cost-related  variables. 

Developing  an  in-house  or  independent-contractor  capability  to 
construct  detailed  engineering  estimates  for  electronic  equip¬ 
ment.  To  establish  such  a  capability  will  require  coordination 
of  Service  laboratories,  procurement  commands,  project  offices, 
and  contractor  support. 
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•  DOD  should  standardize  life-cycle  cost-estimating  for  specific 
types  of  electronics  and  should  provide  all  Service  cost  factors 
needed  by  the  models  to  derive  operations  and  maintenance  costs 
that  are  comparable  and  consistent. 
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Array  Processor,  paper  given  at  Fall  Joint  Computer  Conference, 
Goodyear  Aerospace  Corporation,  Akron,  Ohio,  5-8  December  1972. 
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Radar  Reliability  and  Its  Impact  on  LCC  for  APQ-113,  -114,  -120,  and 
-144  Radars,  Technical  Report  ASD-TR-73-22 ,  April  1973.  (Prepared 
for  Deputy  for  Engineering,  Aeronautical  Systems  Division,  Air  Force 
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considered  outside  the  scope  of  the  present  discussion.  For  addi¬ 
tional  views  on  institutional  bias,  see  Electronics-X  Working  Paper 
9,  available  at  the  IDA  Library. 
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43.  One  of  the  most  comprehensive  discussions  of  these  data  problems  in 
the  avionics  area  is  in:  Naval  Air  Development  Center,  Avionics 
Data  Collection  and  Cost  Prediction,  Report  NADC-72222-SD,  30 
November  1972. 

44.  The  background  and  basis  for  the  status  of  parametric  cost  estimates 
is  described  in  Electronics-X  Working  Paper  9,  available  at  the  IDA 
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DEFENSE  ADVANCED  RESEARCH  ikROJECTS  AGENCY 

1400  WILSON  HOULEVARD 
ARLINGTON,  VIRGINIA  22209 

TASK  ORDER  FOR  WORK  TO  BE  PERFORMED 


BY 

INSTITUTE  FOR  DEFENSE  ANALYSES 
TASK  ORDER  T-97  DATE  21  February  1973 

You  are  hereby  requested  to  undertake  the  following  task: 

1.  Title:  Electronics -X 

2.  Background:  Sharply  rising  costs  of  electronic  systems  and 
unsatisfactory  field  reliability  mandate  an  initiative  by  DDRuE  to  lower 

the  costs  of  military  electronics  equipment  and  improve  its  field 
reliability/maintainability,  while  still  attaining  acceptable  performance 
and  schedules.  In  furtherance  of  these  objectives,  DDRdE  plans  to 
support,  with  several  contractors,  a  number  of  study  efforts  related  to 
cost  reduction  and  reliability  improvement.  It  is  intended  that  these 
efforts  will  be  monitored  and  the  results  integrated  by  IDA  and  augmented 
as  necessary  to  provide  a  base  of  information  and  tentative  recom¬ 
mendations  for  consideration  by  a  Summer  Study  Group  to  be  convened 
by  IDA.  The  depth  of  the  treatment  of  several  of  the  areas  in  this  overall 
program  will  depend  on  the  timely  availability  of  the  results  of  these 
other  studies  and  on  the  level  of  effort  which  can  be  made  available  to  the 
IDA  studies. 


3.  Task  Objective:  The  overall  program  objectives  are  to  identify  and 
evaluate  current  and  alternative  DoD  and  industry  policies,  procedures 
and  practices  in  development,  production  and  operational  support  which 
most  significantly  influence  acquisition  and  life  cycle  costs  and  field 
reliability  and  tc  recommend  changes  and  improvements  to  reduce  and 
control  such  costs  and  improve  reliability.  In  furtherance  of  these 
objectives,  IDA  will 

a.  Monitor  the  severa1  DDR&E-supported  study  programs,  and 
provide  guidance  and  coordination  of  the  efforts,  to  the  extent  feasible 
within  contractual  constraints,  to  assure  that  the  studies  address 
critical  issues  and  consider  potential  remedial  actions. 
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b.  Perform  supporting  studies  to 

(1)  Determine  the  high  pay-off  areas  --  that  is,  those  classes  of 
systems  or  elements  of  life-cycle  cost  for  which  changes  in  existing 
policies  and  procedures  would  be  of  greatest  value. 

(2)  Examine  comparable  equipment  acquisition  cases  with  a  view 
toward  discovering  the  pathological  elements  in  those  acquisitions  whose 
cost  is  determined  to  be  excessive  or  whose  reliability  is  determined  to 
be  inadequate. 

(3)  Evaluate  potential  remedial  actions  and  alternative  policies, 
procedures  and  practices  aimed  at  reducing  cost  and  increasing 
reliability  of  military  electronics  equipment. 

c.  Integrate  the  output  of  the  many  study  efforts  and  arrive  at 
tentative  conclusions  and  recommendations  as  to  policies,  procedures 
and  practices  which  could  implement  attainment  of  reduced  cost  and 
improved  maintainability /reliability.  Arrange  a  coordinated  briefing, 
to  the  members  of  a  Summer  Study  Group,  on  the  results  of  the  study 
efforts  and  the  tentative  conclusions  and  recommendations  drawn  therefrom. 

d.  Organize  and  convene  a  Summer  Study  Group  composed  of  senior 
DoD  and  industrial  personnel  to  review  the  results  of  the  prior  effort  and 
arrive  at  overall  conclusions  and  recommendations. 

e.  Brief  DoD  officials  on  the  findings  of  the  Summer  Study  Group. 

f.  Edit  and  deliver  the  final  report  of  the  Group. 

4.  Scope;  The  technical  monitoring  of  the  DDR&E-sponsored  study 
efforts  will  include  recommendations  to  DDR&E  for  redirection  when 
appropriate,  but  will  not  include  direction,  supervision,  contract 
negotiation  or  contract  management.  The  breadth  of  coverage  in  this 
study  of  the  various  categories  and  types  of  electronic  equipment  and 
systems  used  by  the  DoD  will  be  determined  by  the  overall  support 
provided  to  the  effort,  including  contracted  DDR&E  studies  and 
augmentation  of  the  IDA  overall  study  integration  and  coordination  team. 

(Se-'  "Level  of  Effort") 
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5.  Schedule:  Work  shall  commence  upon  the  acceptance  of  this  task, 
and  shall  be  completed  by  the  end  of  October  1973. 

Briefing  of  DoD  officials  on  the  findings  of  the  Elcctronics-X  Study 
shall  be  accomplished  about  September  1,  1973.  The  final  report  shall 
be  delivered  about  October  1,  1973. 

Level  of  Effort:  Costs  for  this  study  will  not  exceed  $480,  000 
in  FY  1973  and  $320,  000  in  FY  1974.  Additional  effort  will  be  pro¬ 
vided  by  DDR&E  in  the  form  of  full  and  part  time  study  participants 
from  the  DoD  and  other  contractors. 


7.  Technical  Cognizance:  Assistant  Director  (Electronics),  ODDRStE. 

8.  Distribution  and  Control:  Assistant  Director  (Electronics), 
ODDR&E. 


9.  Specific  Instructions  and  Limitations:  To  guide  this  study  there  will 
be  established  an  OSD  Steering  Croup  chaired  by  the  Assistant  Director 
(Electronics),  ODDRkE.  Close  liaison  will  be  maintained  between  the 
Electronics -X  project  director  and  the  OSD  Steering  Croup  during  the 
work  period. 


A  "need -to -know"  is  hereby  established  in  connection  with  this  task 
and  access  to  information  in  the  field  of  this  task  is  authorized  for 
participating  personnel  and  such  supervisory  and  advisory  personnel  as 
are  deemed  necessary. 


4 


S.  J.  Lukasik 
Director 


ACCEPTED: 


President,  IDA 


DATE: 


fanuary  12.  1973 
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ESTIMATES  OF  DOD  ELECTRONICS  COSTS 
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A.  INTRODUCTION 

A  primary  indicator  of  the  importance  of  electronics  is  the  per¬ 
centage  of  the  annual  defense  budget  allocated  to  electronic  equip¬ 
ment,  subsystems,  and  systems.  The  contribution  of  electronics  to 
the  total  defense  acquisition  and  operating  budget  is  also  vital  in¬ 
formation  if  the  effects  of  continued  budget  constraints  are  to  be 
assessed  and  areas  of  financial  leverage  identified. 

Unfortunately,  Government  expenditures  for  military  electronics 
are  not  readily  visible  in  either  the  budgets  or  the  accounting 
records  at  the  Office  of  the  Secretary  of  Defense  (OSD)  level.  For 
research  and  development  expenditures,  electronics  is  contained  with¬ 
in  program  elements  that  are  either  technology- oriented  or  product- 
oriented.  Electronics  expenditures  are  frequently  a  major  part  of 
these  programs  but  cannot  be  identified  as  an  explicit  percentage  or 
dollar  amount.  This  difficulty  is  also  encountered  frequently  in  the 
procurement  budget,  where  the  level  of  financial  detail  does  not  per¬ 
mit  identification  and  measurement  of  electronic  subsystem  costs. 
Finally,  operations  and  maintenance  costs  for  electronics  have  been 
difficult  to  identify  at  the  OSD  level  because  budgeting  detail  is 
insufficient  to  identify  electronics  allocations,  and  Service  account¬ 
ing  systems  have  not  reported  full  costs  of  electronics  operations 
and  maintenance.* 


Because  of  the  difficulties  associated  with  obtaining  a  detailed 
"bottom-up"  estimate  of  electronics  expenditures  and  the  large  un¬ 
certainties  associated  with  estimating  the  portion  of  weapons  systems 
cost  attributable  to  electronic  subsystems,  a  budgetary  estimate 
using  OASD  (Comptroller)  and  other  data  was  made  to  indicate  the  prob- 

✓ 

able  magnitude  of  actual  electronics  RDT&E,  procurement,  and  support 
costs.  The  DOD  budget  for  1974,  outlined  in  Table  B-l,  was  selected 
for  analysis. 


The  military  Services  have  been  pursuing  the  accounting  of  maintenance 
costs  by  equipment  identification.  However,  these  programs  are  still 
in  the  initial  stages  of  implementation  and  have  yet  to  be  validated. 
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TABLE  B-l.  FY  1974  DOD  BUDGET 


Budget  Category 

Research  and  Development 
Procurement 

Operations  and  Maintenance 
Military  Construction 
Military  Personnel 
Retired  Military  Personnel 
Allowances  and  Other  Outlays 

Total 


Estimated 

Outlay, 

billions 

Percentage 
of  Total 
DOD  Budget 

$  8.1 

10% 

16.5 

20 

21.7 

27 

1.7 

2 

22.5 

28 

4.7 

6 

5.9 

7 

$81.1 

100% 

An  estimate  of  the  Government  "market"  in  electronics  is  com¬ 
piled  annually  by  the  Electronic  Industries  Association  (EIA).  This 
estimate  is  based  upon  a  survey  of  the  EIA  member  companies  and  con¬ 
sists  of  their  estimates  of  future  Government  spending.*  Where  Gov¬ 
ernment  data  do  not  provide  sufficient  detail  or  cost  allocation 
information,  estimates  or  factors  derived  from  the  EIA  forecast,  were 
incorporated  into  the  analyses. 

B.  DOD  EXPENDITURES  FOR  ELECTRONICS  RESEARCH  AND  DEVELOPMENT 

Expenditures  for  electronics  research  and  development  can  be 
estimated  by  a  methodology  which  separates  the  industry  share  of  the 
expenditures  and  estimates  the  electronics  content  of  the  contractual 
effort  separately  from  the  Government  in-house  R&D.  Once  total  elec¬ 
tronics  expenditures  are  estimated  for  each  sector  (Government  and 
industry),  estimates  of  direct  and  indirect  costs  associated  with  each 
sector  can  be  made  by  using  industry  averages  and  Government  program- 
element  analyses . 

* - 

The  Government  "market”  is  defined  by  the  EIA  as  "that  part  of  the 
budget  which  EIA  member  companies  can  pursue  as  business  opportuni¬ 
ties  . " 
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A  summary  of  contract  data  for  the  4  fiscal  years  1969-1972  has 
been  obtained  from  OSD  (Comptroller)  and  is  shown  in  Table  B-2. 

TABLE  B-2.  DOD  EXPENDITURES  FOR 
RDT&E  CONTRACTED  TO  INDUSTRY 

(dollars  in  millions) 


Item 

1969 

Fiscal 

1970 

Year 

1971 

1972 

Total  DOD  RDT&E 

$7,437 

$7,166 

$7,303 

$7,780 

Total  DOD  Contracted  RDT&Ea 

$6,013 

$5,466 

$3,538 

$5,844 

Percentage  of  RDT&E  Contracted 

kO 

• 

o 

00 

76.3% 

75.8% 

75.1% 

aSource:  Ref.  1. 

According  to  these  data,  an  average  of  76.9  percent  of  total  RDT&E 
expenditures  have  been  contracted  to  industry.  If  the  downward  trend 
of  the  contractor  share  is  accounted  for,  the  least-squares  fit  of 
the  data  yields  values  of  72.7  percent  for  FY  1973  and  71.°  percent 
for  FY  1974  for  the  contracted  portion  of  the  budget.  For  FY  1974, 
with  projected  outlays  of  $8.1  billion,  these  percentage  estimates 
indicate  that  the  contracted  RDT&E  will  range  between  $5.8  billion 
and  $6.2  billion. 

The  amount  of  electronics  contained  in  the  $6.0  billion  of  con¬ 
tract  RDT&E  can  be  estimated  by  examining  the  contract  expenditures 
by  Federal  Supply  Classification  groups.  It  was  found  that  the  four 
groups  that  contain  the  bulk  of  all  electronics  RDT&E  are:  aircraft 
equipment  and  supplies  (excluding  airframes,  engines,  and  related 
parts),  missile  and  space  systems,  ships,  and  electronic  and  commun¬ 
ication  equipment.  Within  these  groups  it  was  estimated  that  roughly 
all  of  the  expenditures  on  aircraft  components,  73  percent  of  the  ex¬ 
penditures  on  missile  and  space  systems,  20  percent  of  the  expenditure 


on  ships,  and  all  of  the  expenditures  on  electronic  and  communication 
equipment  were  for  electronics.*  The  4-year  summary  of  these  groups 
and  their  estimated  electronics  content  is  shown  in  Table  B-3. 

TABLE  B-3.  ELECTRONICS  R&D  CONTRACT  EXPENDITURES 

(current  dollars  in  millions) 


Fiscal 

Year 

Item 

1969 

1970 

1971 

1972 

Aircraft  Equipment 
and  Accessories 

$  94.8 

$  36.4 

$  86.4 

$  195.5 

Missiles  and  Space 

2053.7 

1688.9 

1174.7 

1529.7 

Ships 

28.1 

21.5 

15.6 

18.9 

Electronics  and 
Communications 

911.9 

953.7 

1074.0 

1163.4 

Total  Electronics 
Contract  R&D 

$3088.5 

$2700.5 

$2350.7 

$2907.5 

Electronics  Contract 

51.4% 

49.4% 

42.4% 

49.8% 

Expenditures  as 
Percentage  of  Total 
Contract  R&D 

The  average  electronics  content  of  the  4-year  data  presented  in 
Table  B-3  amounts  to  48.3  percent  of  all  contracted  R&D.  For  FY 
1974  expenditures  of  $6  billion,  the  electronics  contract  expend¬ 
itures  based  upon  previous  year  estimates  are  estimated  to  be  $2.9 
billion.  The  distribution  of  this  estimate  between  R&D  categories 
is  shown  in  Table  B-4. 


* 

Derivation  of  these  percentage  estimates  is  discussed  in  Section  E 
of  this  appendix. 
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TABLE  B-4.  R&D  FUNDING  TO  CONTRACTORS,  FY  1974 


Contract  RDT&E  Category 

Dollar 
Amount , 
billions 

Percentage  of 
Total  Contract 
Electronics  R&D 

Percentage 
Total  DOD  R&D 

Electronics  Research, 
Exploratory  Development, 
and  Management  Support 

$0.3 

10% 

4% 

Electronics  Advanced, 
Engineering,  and  Oper¬ 
ational  Development: 

2.6 

90 

32 

Aircraft  Electronics 

$0.4 

16% 

Missile  and  Space 
Electronics 

1.1 

42 

Ship  Electronics 

0.1 

4 

Communications 

1.0 

38 

Total  Contract 

Electronics  R&D  $2.9  100%  36% 


The  Government  portion  of  the  otal  expenditures  for  electronics 

research  and  development  was  estime  ed  by  applying  the  percentage 

distributions  for  all  RDT&E  funds  as  estimated  by  the  Electronic  In- 

2 

dustries  Association  (EIA)  for  FY  1973  in  Table  B-5. 


TABLE  B-5.  DISTRIBUTION  OF  FY  1973  RDT&E  EXPENDITURES'3 


RDT&E  Expenditure  to: 

Dollar  Amount, 
millions 

Percentage 

Distribution 

Industry 

$5642.2 

66.0% 

Government  In-House 

2445.9 

28.6 

Federal  Contract  Research 
Centers 

214.  7 

2.5 

Universities 

199.0 

2.3 

Emergency  Fund 

50.0 

0.6 

dSource:  Ref.  2. 
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Based  upon  previous  estimates  for  a  contracted  electronics  effort  of 
$2.9  billion,  the  EIA  estimate  of  28.6  percent  of  total  expenditures 
incurred  by  the  Government  yields  a  Government  in-house  expenditure 
for  electronics  of  $1.2  billion.  Within  RDT&E  budget  categories, 
the  distribution  is  estimated  by  using  similar  ratio  relationships  as 
shown  in  Table  B-6.  Table  B-7  summarizes  the  combined  R&D  budget 
allocation  estimate  for  electronics. 


TABLE  B-6.  GOVERNMENT  IN-HOUSE  R&D  FUNDING,  FY  1974 


Percentage  of 

Dollar  Amount,  Total  Government  Percentage  of 
Budget  Category  billions  Electronics  R&D  Total  POD  R&D 

Electronics  Research,  $0.2  17%  3% 

Exploratory  Development, 
and  Management 

Electronics  Advanced,  1.0  83  12 

Engineering,  and 

Operational  Development  _  _  _ 

Total  In-House  $1.2  100%  15% 

Electronics  R&D 


TABLE  B-7.  SUMMARY  OF  DOD  FY  1974  R&D  BUDGET  ALLOCATION 


Budget  Category 


Dollar  Amount, 
billions 


Percentage  of 

Total  Percentage  of 

Electronics  R&D  Total  DOD  R&D 


Total  DOD  Electronics  $0.5  12%  7% 

Research,  Exploratory 
Development,  and  Support 

Total  DOD  Electronics  3.6  88  44 

Advanced,  Engineering, 
and  Operational  Develop¬ 
ment  _ 


Total  DOD  Elec-  $4.1  100%  51% 

tronics  R&D 


364 


! 

i  j 

i  i 

j 

f 

) 

\ ) 

i 

) 

i 

i 


* 


As  shown  by  the  summary  tables,  it  is  estimated  that  approxi¬ 
mately  $4.1  billion  or  SI  percent  of  the  total  DOD  budget  for  re¬ 
search  and  development  in  FY  1974  will  be  for  electronics.  Almost 
90  percent  of  the  electronics  expenditures  will  be  for  advanced, 
engineering,  or  operational  development  programs  with  roughly  70 
percent  of  the  work  under  contract.  The  largest  sources  of  elec¬ 
tronics  RSD  contract  expenditures  are  missiles,  space,  and  commun¬ 
ication  equipment.  Aircraft  and  ship  electronics  account  for  another 
20  percent  of  total  contract  amounts.  Electronic  equipment,  subsystem, 
and  system  research  ana  development  therefore  represent  a  substantial 
and  important  part  of  the  DOD  RSD  budget. 

C.  DOD  EXPENDITURES  FOR  ELECTRONICS  PROCUREMENT 

Estimates  of  electronics  procurement  expenditures  were  derived 
by  using  methodology  similar  to  that  employed  for  estimating  research 
and  development  expenditures.  Industry  contract  estimates  were  con¬ 
structed  by  using  averages  of  estimated  electronics  contract  amounts 
for  previous  years.  Government  electronics  expenditures  were  based 
upon  estimates  of  the  electronics  content  of  procurement  operations 
program  elements.  The  sum  of  industry  contracts  and  Government 
support  result  in  the  total  electronics  procurement  estimate. 

The  electronics  industry  share  of  the  total  procurement  ex¬ 
penditures,  estimated  to  be  $16.5  billion  for  FY  1974,  was  estimated 
by  evaluating  contract  distributions  by  Federal  Supply  Classification 
for  fiscal  years  1969  through  1972.  As  shown  in  Table  B-8,  the 
estimated  electronics  content  over  the  4-year  period  was  30.8  per¬ 
cent  of  all  contract  amounts  in  procurement.  The  trend  during  the 
most  recent  3-year  period  indicates  a  greater  percentage  than  the 
average  is  likely  for  projections  of  1974.*  Based  upon  this  trend, 

9 

It  should  be  noted  that  the  contract  procurement  represents  approx¬ 
imately  92  percent  of  the  total  procurement  budget,  which  amounts 
to  $15.2  billion  for  FY  19/4. 
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a  factor  of  34  percent  of  contract  procurement,  or  a  total  of  $5.1 
billion,  was  estimated  for  FY  1974.  The  total  and  projected  elec¬ 
tronics  contract  distribution  by  Federal  Supply  Classification  is 
shown  in  Table  B-9. 


TABLE  B-8 .  DOD  PROCUREMENT  OF  ELECTRONIC  SUPPLIES 

AND  EQUIPMENT 

(current  dollars  in  millions) 


Federal  Supply 

PI  f  i 

Fiscal 

Year 

ciao  o  xx  xv-a 

Code 

XUI  l 

Description 

1969 

1970 

1971 

1972 

12 

Fire-Control  Equipment3 

$  201.3 

$  103.6 

$  157.6 

$  157.5 

14 

Guided  Missiles*5 

2,475.5 

1,515.5 

1,772.2 

2,267.5 

15 

Q 

Aircraft  and  Airframes 

1,172.4 

1,027.3 

990.6 

1,361.1 

16 

Aircraft  Components 

522.1 

339.8 

255.4 

248.1 

58 

Communication  Equipment 

1,920.6 

1,594.9 

1,397.5 

1,825.2 

59 

Power  &  Distribution 
Equipment 

446.7 

309.1 

265.8 

306.7 

66 

Instruments 

531.7 

472.7 

395.5 

473.3 

Total  DOD  Electronics 
Procurement 

$7,279.2  $5,362.9 

$5,234.6  $6,639.8 

Total  DOD  Procurement  $22,845.7 
Out la ys 

18,585.5 

17,509.4 

20,265.1 

Electronics  Percentage 

31 . 9% 

28.9% 

29.9% 

32 . 7% 

of  All  DOD  Contract 
Procurement 

aIncludes  shipboard  installation  of  fire-control  equipment. 
^Estimated  at  75  percent  of  total  contract  amount. 
^Estimated  at  30  percent  of  total  contract  amount. 
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TABLE  B-9.  PROCUREMENT  FUNDING  TO  CONTRACTORS,  FY  1974 


Percentage  of 


Category  of  Electronics 
Weapon  System  Procurement, 
or  Equipment  billions 

Percentage  of 
Total  Contract 
Procurement 

Total  DOD 
Electronics 
Procurement 

Percentage  of 
Total  DOD 
Procurement 

Fire-Control 

Equipment3 

$0.2 

4% 

3% 

1% 

Missiles  &  Space 
Vehicles 

1.7 

33 

29 

10 

Aircraft  Equipment 

1.2 

24 

21 

7 

Electronic  Component  0.2 

4 

4 

1 

Communication 

Equipment3 

1.3 

25 

22 

8 

Electronic 

Instruments 

0.4 

8 

7 

4 

Other 

0.1 

2 

2 

1 

Total  Electronics 
Procurement 

$5J 

100% 

88% 

31% 

aThese  categories  include  approximately  $0.8  billion  in  shipboard 
equipment. 


Government  in-house  expenditures  for  electronics  procurement 
were  estimated  at  $700  million  or  approximately  50  percent  of  total 
in-house  procurement  expenditures.  While  the  precise  allocation  of 
these  costs  has  not  been  investigated,  the  majority  of  electronics 
procurement  support  costs  are  believed  to  be  in  the  large  procurement 
operations  associated  with  the  AECOM,  AFSC,  NAVAIR,  and  NAVELEX  organ¬ 
izations.  Procurement  support,  funded  under  the  operations  and  main¬ 
tenance  budget  category,  could  logically  be  assigned  to  this  category 
as  well.  These  expenditures  total  approximately  $0.5  billion  annually 
out  of  a  total  Program  VII  general  supply  budget  of  $2  billion. 


36  7 


A  summary  of  estimated  F/  1974  electronics  piocurement  is  shown 
in  Table  B-10.  These  estimat  s  show  that  approximately  $5.8  billion 
or  35  percent  of  all  DOD  procurement  outlays  for  FY  1974  are  for  elec¬ 
tronics.  Most  of  the  funds  are  expended  by  contractors,  as  expected. 
Expenditures  for  missiles,  space,  aircraft,  and  communication  equip¬ 
ment  (including  shipboard  equipment)  represent  roughly  70  percent  of 
all  electronics  procurement  outlays,  for  a  total  contract  amount  of 
$4.2  billion.  The  major  part  of  these  expenditures  is  for  equipment 
and  subsystems  that  are  integrated  with  and  installed  in  complete  air¬ 
craft,  missile,  or  space  systems. 


TABLE  B-10.  SUMMARY  OF  DOD  FY  1974  ELECTRONICS 
PROCUREMENT  BUDGET  ALLOCATION 


Budget  Category 

Estimated 
Electronics 
Expenditures , 
billions 

Percentage  of 
Total 

Electronics 

Procurement 

Percentage  of 
Total  DOD 
Procurement 

Industry  Contracts 

$5.1 

88% 

31% 

Government  In-House 
Procurement  Support 

0.7 

12% 

4% 

Total  DOD  Electronics  $5.8 
Procurement 

100% 

35% 

D.  DOD  EXPENDITURES 

FOR  ELECTRONICS 

SUPPORT 

The  cost  of  electronics  support  has  been  one  of  the  most  diffi¬ 
cult  areas  co  estimate  accurately  because  of  the  large  quantity  and 
many  types  of  equipment,  subsystems,  and  systems  in  the  field  and  the 
difficulties  encountered  in  apportioning  direct  and  indirect  costs 
associated  with  maintenance  costs  of  specific  equipments.  Since  only 
a  gross  examination  was  attempted  during  this  study,  the  resulting 
estimates  are  acknowledged  to  be  imprecise. 

The  term  "electronics  support"  is  defined  here  as  including 
those  elements  of  the  Operations  and  Maintenance  (O&M)  and  Military 
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Personnel  (MP)  budget  categories  that  relate  to  logistic  support  and 
maintenance  of  electronic  equipment.  The  cost  of  actually  operating 
electronic  equipment  is  specifically  excluded  from  these  estimates. 
Four  methods  of  arriving  at  estimated  annual  support  costs  are  treated 
below. 

Method  1.  Bottom-Up  Estimate  from  Budget  Data 

Within  the  O&M  budget  category  are,  among  other  items,  prime 
contract  awards  for  maintenance  services.  These  are  enumerated  in 
Table  B-ll  for  the  fiscal  years  1969-1972;  for  FY  1972  the  total  was 
$377  million. 

TABLE  B-ll.  ELECTRONICS  CONTRACT  EXPENDITURES  FOR 
MAINTENANCE  SERVICES 

(current  dollars  in  millions) 


Fiscal 

Year 

Description 

1969 

1970 

1971 

1972 

Aircraft  Electronics  Maintenance 

$  95.2 

$  53.3 

$  86.7 

$105.1 

Missile  Electronics  Maintenance 

37.6 

21.8 

18.2 

23.5 

Communications  Maintenance 

96.4 

76.8 

79.9 

93.2 

Communications  Modifications 

57.5 

68.6 

72.9 

91.9 

Electronics  Technical  Repre¬ 
sentatives,  Aircraft 

6.8 

11.4 

7.3 

8.9 

Technical  Representatives,  Missiles  24.3 

6.9 

9.4 

9.9 

Technical  Representatives, 
Communications 

76.4 

59.9 

52.3 

44.1 

Total  Electronics  Contract 

$394.2 

$338.7 

$326.7 

$376.6 

Maintenance  Services 
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A  second  element  of  the  O&M  budget  that  is  directly  related  tu 
electronics  support  comprises  the  salaries  of  civilian  employees  at 
military  electronics  maintenance  depots.  The  number  of  employees^  is 
18,601,  and  their  average  salary,  based  on  salaries  at  the  Sacramento 
Army  Depot,  is  $12,500  plus  14  percent  for  retirement  and  fringe 
benefits.  The  total  for  this  item  is  $266  million. 

A  third  element  of  the  O&M  budget  category  represents  an  in¬ 
direct  cost  of  electronics  maintenance:  that  fraction  of  adminis¬ 
trative,  central  supply  and  maintenance,  and  training  and  medical 
costs  that  is  associated  with  support  of  the  military  personnel  work¬ 
ing  in  electronics  maintenance.  The  number  of  military  personnel  with 
electronics  maintenance  military  occupational  specialties  (MOSs)  as¬ 
signed  to  electronics  maintenance  is  estimated0  as  172,643  or  7.58 
percent  of  the  total  average  number  of  personnel  in  the  armed  forces 
in  FY  1974.  Applying  this  percentage  to  the  specified  cost  elements 
in  the  O&M  category  yields  an  amount  of  $792  million. 

Finally,  the  O&M  budget  category  includes  the  cost  of  operating 
the  Defense  Supply  Agency  (DSA).  The  electronics  content  of  the  in- 
use  military  inventory,  as  developed  later  in  this  appendix,  is  28 
percent.  Applying  this  percentage  to  the  DSA  O&M  element  yields  $197 
million. 

Turning  to  military  personnel  ousts,  rhe  first  element,  direct 
compensation  and  expenses,  is  taken  as  7.58  percent  of  the  total  MPA 
budget  category,  excluding  reserve  pay,  and  is  found  to  be  $1587  mil¬ 
lion. 

The  indirect  electronics  maintenance  cost  of  military  adminis¬ 
trative  personnel  to  support  the  electronics  maintenance  personnel 
is  estimated  at  7.58  percent  of  this  MPA  cost  element,  and  yields 
$35  million. 

The  indirect  electronics  maintenance  cost  of  training  and  med¬ 
ical  military  personnel  to  support  electronics  maintenance  personnel 
is  estimated  at  7.58  percent  of  this  MPA  cost  element,  or  $510  million. 
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Finally,  based  on  the  ratio  of  1974  retirement  costs  to  total 
1974  personnel  costs  excluding  reserves,  military  retirement  costs  are 
estimated  at  22.5  percent  of  the  annual  military  personnel  costs  di¬ 
rectly  or  indirectly  allocable  to  electronics  maintenance;  this  amounts 
to  $479  million. 

To  summarize  the  electronics  support  cost  estimate  obtained  by 
this  approach,  we  find: 

billions 


I 

I 


Contract  maintenance  (O&M) 

$0,377 

% 

J 

Depot  civilians,  including  fringe 

0.266 

i 

benefits  and  retirement  (O&M) 

| 

J 

Allowable  administrative,  central 
supply,  training  and  medical  (O&M) 

0.792 

1 

Electronics  content  of  DSA  (O&M) 

0.197 

| 

\ 

J 

Military  maintenance  personnel 

1.587 

costs  (MP) 

) 

Allocable  military  administrative 
costs  (MP) 

0.035 

J 

Allocable  training  and  medical 
military  personnel  (MP) 

0.510 

l 

Military  retirement  costs  (Ret.) 

0.479 

1 

’ ) 

$4,243 

i 

Thus,  the  total  annual  electronics  support 

cost  estimated 

by 

? 

) 

this  method  is  $4.2  billion. 

In  estimates  such  as  the  above,  there  is  a 

strong  likelihood 

} 

- 

that  certain  elements  of  support  cost  have  been 

overlooked .  To 

ob- 

1 

tain  alternative  estimates,  three  other  approaches  were  pursued  and 
are  described  below. 


) 


Method  2.  Extrapolation  from  Standard -Function  Avionics  Maintenance 
Costs 


Arinc  Research  Corporation  has  made  a  careful  independent  esti- 

4 

mate  of  the  annual  maintenance  cost  of  communication,  navigation, 
and  identification  (CNI)  avionics  for  38  commonly  used  Air  Force 
equipments.  The  estimates  are  based  on  AFM  66-1  maintenance  action 
records  and  take  into  account  both  field  and  depot  maintenance.  The 
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estimated  cost  of  field  maintenance  included  Jabor  at  $10  per  man-hour, 
including  overhead,  but  excluded  parts  costs.  The  estimated  depot  re¬ 
pair  costs  included  labor,  parts,  overhead,  G6A,  etc.,  averaged  per 
depot  maintenance  action  times  the  number  of  depot  referrals  observed 
during  the  sampling  period.  The  samDling  period  was  July  1970  to  June 
1971. 

The  operating  duty  factor  for  the  equipments  was  assumed  to  be 
equal  to  that  of  the  aircraft  in  which  they  were  commonly  employed, 

7.0  percent.  This  duty  factor  is  assumed  to  be  not  unreasonable  for 
military  electronic  equipments  other  than  those  used  in  aircraft. 

The  total  annual  maintenance  cost,  weighted  by  inventory  quan¬ 
tity,  for  these  38  equipments,  was  derived  from  the  Arinc  Research  re¬ 
sults  as  $46  million.  To  this  we  add  the  cost  of  repair  parts  used 
in  field  maintenance,  estimated  at  5  percent  of  the  field  maintenance 
labor  costs,  which  are  in  turn  (from  Arinc  Research  data)  estimated 
at  86  percent  of  the  total.  The  total  annual  maintenance  cost  be¬ 
comes  $48  million.  The  investment  cost  for  the  38  equipment  types, 
taking  into  account  the  quantity  of  each,  is  $341  million. 

Thus,  the  annual  maintenance  cost  as  a  fraction  of  investment 
cost  is  estimated  at  14.14  percent. 

Applying  this  same  ratio  to  the  current  DOD-wide  in-use  elec¬ 
tronics  inventory  of  $31.1  billion,  as  estimated  later  in  this  app¬ 
endix,  the  annual  support  cost  for  military  electronics  is  estimated 
as  $4.4  billion. 

Method  3.  Estimation  from  Failure  Rates  and  Cost  per  Failure 

The  total  DOD  in-use  avionics  inventory  is  estimated  at  $13.9 
billion;  the  remainder  of  electronics  is  estimated  at  $17.2  billion 
(Table  B-14).  From  Fig.  II-5,  in  Part  II  of  this  report,  it  is  seen 
that  the  median  rate  of  failures  per  operating  hour  per  dollar  of  unit 
production  cost  is,  for  avionics,  7.69  x  10  .  From  the  Arinq  Re¬ 

search  results  previously  cited,  the  average  number  of  operating  hours 
per  year  i^  617.  Thus,  the  yearly  number  of  failures  for  the  avionics 
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inventory  is  6.595  x  10^.  Two  widely  differ ing  estimates  of  the  cost 
per  failure  can  be  derived:  from  a  General  Electric  studyJ  of  air¬ 
borne  radars,  there  are  2.85  maintenance  actions  per  failure,  and  the 
cost  of  each  maintenance  action  is  $220  (without  source  citation)  for 
a  cost  per  failure  of  $627.  On  the  other  hand,  one  can  derive  from 
the  Arinc  Research  results  a  weighted  average  cost  per  failure  of 
$298.  Assuming  that  one-third  of  avionics  is  as  difficult  to  service 
as  airborne  radars,  while  the  remainder  is  comparable  to  the  CNI  equip¬ 
ments  of  the  Arinc  Research  study,  the  two  figures  can  be  weighted 
and  averaged.  At  the  average  cosJ  per  failure  of  $408,  the  annual 
cost  of  maintenance  of  the  avionics  inventory  is  estimated  at  $2.69 
billion. 

The  failure  rate  for  the  non-avionics  inventory  is  lower  than 
that  for  avionics.  Using  the  very  limited  results  from  Army  Area 
Communications  System  (AACOMS)  equipment,  a  rate  of  10-7  failures  per 
operating  hour  per  dollar  of  inventory  is  indicated.  The  number  of 
operating  hours  per  year  is  assumed  to  be  876,  for  a  duty  factor  of 
10  percent.  The  maintenance  cost  per  failure  is  assumed  to  be  $225 
per  failure,  somewhat ^less  than  that  for  simple  avionics.  From  these 
assumptions,  the  annual  maintenance  cost  for  non-aircraft  electronics 
is  estimated  at  $3.39  billion. 

Thus,  the  total  cost  of  support  of  the  military  electronics  in- 
use  inventory  is  estimated  by  this  method  as  $6.1  billion. 

Method  4.  Electronics  Maintenance  Costs  Estimated  from  Total  Mil¬ 
itary  Maintenance  Costs 

The  Director  for  Maintenance  Policy,  0ASD(I6L),  estimates  total 
annual  DOD  maintenance  costs  as  follows: 
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billions 

635,000  military  maintenance  personnel 

$6.0 

275,000  DOD  civilian  and  225,000  private 

6.0 

contractor  personnel 

Maintenance  supplies 

5.0 

Transportation 

1.0 

Modifications  and  alterations 

2.0 

Base  support 

1.4 

Retirement  pay 

1.0 

X 

Training  of  maintenance  personnel 

1.0 

Reserves 

0.5 

X 

Military  construction 

0.2 

Technical  representatives 

0.1 

X 

Total  $24.2 


Technical  manuals,  tools,  and  test  equipment  are  excluded  from 
this  estimate  to  avoid  double  counting  with  procurement  cost. 

As  noted  earlier,  electronics  constitutes  an  estimated  28  per¬ 
cent  of  the  military  in-use  inventory.  Assuming  that  electronics 
consumes  this  same  fraction  of  the  defense  maintenance  outlay,  the 
annual  electronic  support  cost  is  estimated  at  $6.8  billion. 

Average  and  Standard  Deviation  of  the  Four  Estimates 

The  average  of  the  estimates  of  annual  electronics  support  cost 
made  by  the  four  methods  is  $5.4  billion. 

The  standard  deviation  is  $1.1  billion,  and  indicates  a  large 
uncertainty  in  the  result.  Verification  of  these  estimates  and  more 
precise  resolution  of  the  broader  question  of  total  electronics  main¬ 
tenance  costs  must  await  further  development  of  the  cost  accounting 
systems  and,  perhaps  equally  important,  a  definition  by  consensus  of 
exactly  what  costs  should  be  identified  with  electronics  maintenance. 


374 


E.  THE  CONTRIBUTION  OF  INDIRECT  COSTS 


The  contribution  of  indirect  or  overhead  support  costs  as  a 
major  portion  of  the  total  electronics  budget  allocation  has  been 
discussed  briefly  above.  While  there  is  no  way  to  estimate  precisely 
what  the  aggregate  percentage  of  support  costs  is  for  electronics, 
typical  relationships  can  serve  to  illustrate  the  importance  of  these 
costs  in  the  total  budget. 

In  the  industrial  sector,  indirect  costs  can  contribute  between 
50  and  80  percent  of  total  contract  costs,  depending  upon  the  nature 
of  the  contracted  effort,  the  amount  of  subcontract  costs  contained 
within  the  contract,  and  the  contractor’s  business  base.  Studies  by 
Martinson  and  Jarrett6’7  both  show  that  typical  indirect  cost  con¬ 
tributions  for  aerospace  contracts  are  between  60  and  70  percent  of 
total  contract  costs,  depending  upon  the  amount  of  subcontract  effort. 
Based  upon  the  ranges  of  indirect  cost  contribution  found  by  these 
studies,  a  60  percent  indirect  cost  share  was  estimated  for  R&D  and 
O&M  contracts,  and  a  66  percent  share  ratio  was  used  for  procurement 
estimates,  the  larger  percentage  reflecting  the  greater  number  of  sub¬ 
contracting  or  purchasing  efforts  contained  within  the  procurement 
of  equipments,  subsystems,  and  complete  weapon  systems. 

The  indirect  costs  incurred  by  the  Government  are  much  more 
difficult  to  estimate  because  of  problems  in  identifying  and  appor¬ 
tioning  the  costs  to  electronic  systems.  For  research  and  development 
expenditures,  a  Government  overhead  rate  of  1.4  was  estimated  by 
assuming  that  Program  Element  6.5,  Management  and  Support,  was  essen¬ 
tially  overhead  or  indirect  cost  and  by  calculating  the  ratio  of 
Government  Program  Element  6.5  costs  to  the  balance  of  Government  R&D 
expenditures.  Indirect  ratios  for  Government  procurement  were  esti¬ 
mated  by  calculating  the  ratios  of  procurement  support  and  central 
supply  support.  For  electronics,  these  activities  were  estimated  at 
$0.15  billion  and  $0.5  billion,  respectively,  for  an  indirect  rate  of 
approximately  200  percent.  The  distributions  represented  by  the 
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direct  and  indirect  allocation  of  the  electronics  budget  are  shown  in 
Table  B-12  and  Fig.  B-l. 

TABLE  B-12.  SUMMARY  OF  DOD  ELECTRONICS 
DIRECT  AND  INDIRECT  COST  ALLOCATION 


Research  and  Development  _ Procurement 


Sector  and 

Cost  Category 

Dollar  Amount, 
billions 

Percentage 
of  Total 

Dollar  Amount, 
billions 

Percentage 
of  Total 

Industry 

Direct 

$1.2 

29% 

$1.7 

29% 

Indirect 

1.7 

42 

3.4 

59 

Government 

Direct 

0.5 

12 

0.2 

3 

Indirect 

0.7 

17 

0.5 

9 

Total 

$4.1 

100% 

$5.8 

100% 

RESEARCH  AND 
DEVELOPMENT 
Vi.  I  II  III  ON 


PROCUREMENT 
S  5.8  tllllON 


FIGURE  B-1 .  DOD  Electronics  Budget  Acquisition  Cost  Distributions 
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F.  THE  COST  OF  ELECTRONICS  IN  WEAPONS  SYSTEMS 


A  major  problem  area  in  estimating  total  electronics  expend¬ 
itures  is  the  determination  of  the  electronics  cost  portion  associated 
with  complete  weapons  systems.  Given  the  three  major  classes  of 
weapons — aircraft,  missiles,  and  ships,  it  is  impossible  to  provide 
more  than  rough  estimates  of  electronics  content  at  the  aggregate 
level  for  each  class.  Even  within  each  class,  groups  or  individual 
weapons  systems  are  difficult  to  analyze  for  characteristic  elec¬ 
tronics  cost  content. 

In  the  major  category,  aircraft,  electronics  content  can  range 
from  5  percent  of  flyaway  cost,  as  in  utility  helicopters,  to  30  per¬ 
cent,  as  in  the  F-14A.  Electronic-warfare  aircraft,  whose  primary 
mission  is  electronic,  can  represent  considerably  greater  percentages 
of  total  flyaway  cost.  The  cost  of  airborne  electronics  is  obscured 
further  by  the  fact  that  the  total  electronics  costs  must  consider 
equipment  installation,  integration  and  test,  ground  support  equip¬ 
ment,  and  initial  spares  costs,  in  addition  to  discrete  equipment 
costs.  These  additional  costs  were  analyzed  for  the  mission  avionics 
of  11  tactical  fighters  in  a  previous  IDA  study,  which  showed  that 
while  the  mission  avionics  equipment  represented  an  average  of  16 
percent  of  aircraft  flyaway  costs,  the  systems  cost  (including  the 

g 

equipment)  averaged  33  percent  of  aircraft  flyaway.  Consideration 
of  the  total  electronics  content  of  these  aircraft,  including  com¬ 
munications,  identification,  and  electrical  power  systems,  would 
have  resulted  in  even  greater  cost  percentages.  Similar  percent¬ 
ages  are  used  by  other  estimators;  the  Navy  uses  a  factor  of  28  per- 

9 

cent,  and  the  Electronic  Industries  Association  (EIA)  estimates  27 
percent’*"0  of  aircraft  procurement  is  electronics.  Based  upon  some¬ 
what  higher  estimates  from  IDA  studies,  30  percent  has  been  adopted 
for  the  estimates  contained  herein. 

The  electronics  content  of  missile  expenditures  represents 
greater  estimating  uncertainties  than  experienced  with  aircraft  be¬ 
cause  of  the  difficulties  in  the  identification  of  "missile 
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electronics”  and  the  wide  variety  of  missile  systems,  ranging  from 
simple  BULLPUP  guided  bombs  to  POSEIDON,  MINUTEMAN,  and  SAFEGUARD. 
While  all  available  "flyaway”  cost  data  indicate  that  the  electronics 
contained  in  the  guidance  and  control  portions  of  the  missiles  rep¬ 
resents  between  60  and  80  percent  of  the  cost,  total  program  costs, 
which  include  ground  support  and  command  and  control  equipment,  can 
yield  a  much  broader  range  of  estimates. 

EIA  bases  its  estimate  of  the  electronics  content  of  missiles 
on  a  factor  for  aggregate  electronics  in  missile  procurement  of  45 
percent.  On  the  basis  of  data  on  missile  flyaway  costs  and  elec¬ 
tronics  content,  it  is  believed  that  this  estimate  is  significantly 
understated  and  that  an  average  apportionment  of  75  percent  is  a 
better  aggregate  estimate.  An  example  of  tactical  missile  electronics 
content  is  shown  in  Table  B-13,  which  substantiates  the  higher  esti¬ 
mate.  More  detailed  analyses  are  needed  to  get  a  better  estimate 
that  would  account  for  all  appropriate  missile  electronic  costs. 

Ship  electronics,  like  missile  electronics,  can  also  range 
from  low  percentages  to  major  portions  of  total  ship  costs.  A  sig¬ 
nificant  factor  in  ships  is  the  installation  of  ship  elec¬ 
tronics,  which  can  cost  as  much  as  the  installed  equipment.  The  Navy 
estimates  that  12  percent  of  ship  construction  cost  and  30  percent 
of  ship  modification/support  cost  is  electronics  cost.  The  EIA  uses 
an  average  of  23  percent  of  total  ship  procurement  as  the  electronics 
cost  factor,  which  agrees  with  the  aggregate  Navy  estimates.  The  EIA 
estimates  are  therefore  believed  to  be  representative  of  the  value 
associated  with  shipboard  electronics. 

As  indicated  above,  the  use  of  aggregate  electronics  budget 
factors  can  provide  only  rough  approximations  of  the  electronics 
budget  allocation.  The  resulting  total  cost  estimates  are  probably 
only  accurate  to  within  a  ±  20  percent  estimate  bandwidth.* 

«» 

The  range  of  estimates  derived  from  the  EIA  electronics  forecast  is 
±  14  percent. 
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Therefore,  until  a  detailed  program -by-program,  weapon-by-weapon 
analysis  is  accomplished  for  the  fiscal  year,  the  aggregate  estimates 
will  have  to  be  used,  recognizing  the  uncertainties  which  exist. 


TABLE  B-13.  TACTICAL  MISSILE  ELECTRONICS 
CONTENT  AND  FLYAWAY  COSx 

(dollar  amounts  in  constant  1970  dollars) 


Missile 


Average  Unit 
Flyaway  Cost 


Unit 

Guidance  & 
Control  Cost 


Electronics 

Content, 

percent 


BULLPUP  12-B 

$  4,375 

$  2,537 

58% 

BULLPUP  12 -C 

6,228 

3,052 

49 

FALCON  4-A 

9,039 

8,044 

89 

SIDEWINDER  9-D 

9,980 

6,487 

65 

FALCON  4-F 

14,117 

12,140 

86 

SHRIKE 

15,192 

9,870 

65  x  =  75.4% 

SIDEWINDER  9-C 

18,286 

14,810 

81  o-  =  12% 

SPARROW  7-D 

20,330 

16,460 

81 

FALCON  26-A 

21,113 

17,315 

82 

SPARROW  7-E 

22,022 

19,160 

87 

Standard  MR 

44,319 

31,020 

70 

Standard  ER 

46,462 

30,650 

66 

SPARROW  7-F 

68,898 

56,500 

82 

TALOS 

112,094 

99,800 

77 

Standard  ARM 

138,291 

123,000 

89 

PHOENIX 

450,000 

396,000 

88 

HOUNDOG 

609,078 

400,000 

66 

*Data  Sources:  Refs.  11,  12. 
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G.  THE  INVENTORY  Of  ELECTRONIC  EQUIPMENT 


t 

l 


To  put  the  importance  of  electronics  in  final  perspective,  it  is 
desirable  to  obtain  a  rough  estimate  of  the  inventory  of  electronic 
equipment  as  a  percentage  of  the  total  DOD  inventory. 

The  total  DOD  inventory  of  real  and  personal  property  at  the 
end  of  FY  1972  was  estimated  at  $219.4  bill!  n.^  As  shown  in 
Fig.  B-2,  the  Navy  and  the  Air  Force  manage  $167  billion,  or  76  per¬ 
cent,  of  this  total  amount.  The  largest  contributors  to  the  in¬ 
ventory  are  equipment  in  use  (50  percent),  equipment  in  the  supply 
system  (20  percent),  and  real  property  (19  percent). 

Estimates  for  the  electronics  content  of  the  equipment  in  use 
and  in  the  supply  system  were  attempted  by  using  detailed  OASD 
(Comptroller)  inventory  reports  from  the  Services.  It  was  found 
that  the  level  of  aggregation  provided  by  the  inventory  reporting 
system  to  the  Comptroller  did  not  identify  specific  categories  of 
electronic  equipment  except  communication  equipment,  and,  as  found 
in  contract  procurement  data,  the  percentage  of  electronics  contained 
as  integral  parts  of  complete  end -item  weapons  systems  was  not  vis¬ 
ible  for  analysis.  The  estimate  of  electronics  content  therefore  had 
to  be  constructed  by  using  factors  previously  developed  for  weapon- 
system  electronics  content. 

Based  on  the  Comptroller  data,  the  inventory  of  equipment  in 
use  and  the  estimated  electronics  content  is  compiled  in  Table  B-14. 
It  is  thus  estimated  that  approximately  28  percent  of  the  inventory 
value  of  all  equipment  in  use  is  electronics,  and  the  inventory  val¬ 
uation  totaled  $31  billion  for  FY  1972.  The  Navy  and  the  Air  Force 
are  each  estimated  to  have  approximately  $13  billion  in  the  elec¬ 
tronics  inventory,  or  about  25  percent  of  their  total  in-use  in¬ 
ventories.  The  Army  is  estimated  to  have  only  $5  billion  in  elec¬ 
tronics  inventory  in  use.  However,  this  amounts  to  35  percent  of  the 
total  in-use  inventory  value. 
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[ Source :  OASD  (Comptroller) ] 


( 


Army 


Airci-aft  $  3.1 

Missiles  2.6 

Tanks  and  Combat  Vehicles  2.9 

Tactical  &  Support  Vehicles  2.4 
Electronic  &  Communication  1.7 

Equipment 

Other  Support  Equipment  2.6 

Total  Army  $  14.4 

Navy 

Ships  $  34.7 

Service  Craft  1.1 

Aircraft  13.9 

Aircraft  GSE  1.1 

Missiles  0.9 

Ammunition  0.7 

Other  1.0 

Total  Navy  $  53.4 

Air  Force 

Aircraft  $  29.4 

Missiles  3.5 

Electronic  &  Communication  1.8 

Equipment 

Vehicles  1.0 

Unit  Mission  Equipment  6.5 

Other  0.1 

Total  Air  Force  $  42.3 
GRAND  TOTAL  $110.1 


30% 

$  0.9 

75 

1.9 

10 

0.3 

L 

100 

1.7 

10 

0.3 

L 

35% 

$  5.1 

L 

I 


20% 

$  6.9 

4 

— 

— 

30 

4.2 

50 

0.6 

s 

75 

0.7 

v_ 

-- 

< 

f 

10 

0.1 

1 

23% 

$  12.5 

< 

30% 

$  8.8 

i 

75 

2.6 

100 

1.8 

10 

0.6 

33% 

$  13.8 

28% 

$31.1 
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The  electronics  content  of  the  defense  inventory  in  the  supply 
system  (including  depots)  is  shown  in  Table  B-15.  It  is  estimated 
that  approximately  22  percent  of  all  equipment  value  is  electronic, 
yielding  a  total  DOD  electronic  supply  system  inventory  of  $9.7 
billion.  The  Service  percentages  of  equipment  are  estimated  at: 

Army,  34  percent;  Navy,  33  percent;  and  Air  Force,  28  percent.  The 
Defense  Supply  Agency  accounts  for  the  remaining  4  percent. 

The  total  electronic  equipment  either  in  the  supply  system  or 
in  field  use  is  estimated  to  be  $40.8  billion  for  FY  1972.  This  rep¬ 
resents  approximately  26  percent  of  the  total  DOD  equipment  inventory 
and  corresponds  roughly  to  7  times  the  annual  electronics  procurement 
expenditure. 

It  should  be  recognized  that  the  valuation  of  the  inventory  has 
not  been  analyzed  in  depth  and  that  the  value  of  the  equipment  on  the 
books  may  be  either  original  acquisition  price  or  a  discounted  or 
depreciated  amount.  The  current  replacement  cost  of  the  inventory  is 
likely  to  be  substantially  greater  than  inventory  totals. 

The  total  equipment  inventory  and  its  electronics  content  are 
summarized  in  Table  B-16. 
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TABLE  B-15.  INVENTORY  OF  WEAPONS  AND  EQUIPMENT 
IN  SUPPLY  SYSTEMS 

(dollars  in  billions) 


Total 

Estimated 

Electronics 

Electronics 

Supply 

Content , 

Supply 

Inventory 

percent 

Inventory 

Principal  Items 

Weapons 

$  0.6 

— % 

$  - 

Ammunition 

8.9 

-- 

— 

Nonstrategic  Missiles 

2.4 

75 

1.8 

Tanks,  Combat  Vehicles 

3.0 

10 

0.3 

Support  Vehicles 

0.1 

5 

— 

Electronic  &  Communication 

2.2 

100 

2.2 

Equipment 

Other  Support  Equipment 

1.7 

10 

0.2 

Aircraft  Engines 

2.5 

-- 

— 

Shipboard  Equipment 

0.4 

20 

0.1 

Subtotal 

$21.8 

21% 

$  4.6 

Secondary  Items 

Aircraft  Components 

$  9.9 

30% 

$  3.0 

Missile  Parts 

1.1 

75 

0.8 

Weapons  Parts 

0.9 

10 

0.1 

Tank  &  Vehicle  Parts 

0.8 

10 

0.1 

Ship  &  Submarine  Parts 

0.3 

20 

0.1 

Ammunition  Components 

0.1 

— 

— 

Other  Repair  Parts 

0.6 

— 

POL 

0.4 

-- 

-- 

Clothing  &  Textiles 

1.0 

— 

— 

Subsistence 

0.4 

-- 

— 

Medical-Dental  Supplies 

0.3 

— 

— 

Electronic  Parts 

1.3 

100 

1.3 

Other  Stock  Items 

1.5 

-- 

— 

Shipboard  Supplies 

1.1 

-- 

-- 

Miscellaneous 

2.6 

— 

-- 

Subtotal 

$20.8 

25% 

$  5.1 

TOTAL  SUPPLY 

$44.1 

22% 

$  9.7 
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TABLE  B-16.  EQUIPMENT  INVENTORY  ESTIMATES 
FOR  FY  1972 

(dollars  in  billions) 


All  Equipment 

Electronics 

Content 

Percentage 

Electronics 

Military  Equipment 
in  Use 

$110.1 

$31.1 

28% 

Military  Equipment 
in  Supply  Systems 

44.1 

9.7 

22 

Total  DOD  Inventory 

$154.2 

$40.8 

26% 

H.  SUMMARY  OF  THE  ELECTRONICS  COST  CONTRIBUTION 

The  importance  of  electronics  in  the  Department  of  Defense  can 
be  readily  substantiated  by  a  review  of  the  estimated  cost  impact  in 
both  the  annual  budget  and  the  existing  inventory.  Analysis 
of  the  existing  data  indicates  a  total  estimated  expenditure  of 
$15.3  billion  in  FY  1974,  or  19  percent  of  the  total  DOD  budget.  It 
was  also  found  that  approximately  58  percent  of  the  electronics  ex¬ 
penditures  are  ultimately  consumec  by  industrial  firms  under  contract 
and  that  indirect  or  overhead  portions  of  the  expenditures  roughly 
represent  $2  out  of  every  $3  spent.  The  electronics  in  the  inventory 
was  estimated  at  26  percent  or  $41  billion  of  the  $154  billion  total 
DOD  equipment  inventory.  The  electronic  equipment  in  use  amounts  to 
about  $31.1  billion  and  requires  about  $5.4  billion,  or  17  percent 
of  investment,  annually  for  support. 
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A.  MARK  II  AVIONICS  FOR  F-lll  AIRCRAFT1 

Table  C-l  shows  the  information  import  int  to  this  investigation. 
There  was  a  difference  of  opinion  on  the  requirement.  Many  in  the  Ser¬ 
vice  R&D  senior  headquarters  staff  believed  that  with  modest  changes 
and  additions  to  the  existing  system,  well  within  the  state  of  the  art, 
it  would  be  possible  to  achieve  the  attack  avionics  improvements  that 
would  be  useful  and  necessary,  and  to  add  a  relatively  modest  air-to- 
air  capability.  However,  requirements  and  technical  staffs  and  the 
aspiring  avionics  contractors  pressed  for  an  integrated  system  with  a 
centralized  digital  processor  that  was  later  found  to  be  pressing  the 
state  of  the  art.  Key  components  of  the  integr  ’•'ed  display  had  barely 
been  demonstrated  in  the  laboratory.  The  Secretary  of  Defense  decided 
in  favor  of  the  advanced  system.  Later  reviews  did  not  lead  to  a  deci¬ 
sion  to  reduce  performance  specifications  when  it  was  found  that  costs 
were  becoming  excessive.  Ultimately,  the  specif ications  for  the  dis¬ 
play  did  have  to  be  changed  to  permit  it  to  function  at  all. 

B.  C-5A  NAVIGATION  SUBSYSTEM2 

The  essential  data  are  given  in  Table  C-2.  Again,  this  case 
illustrates  the  impact  of  a  requirement  for  extreme  performance.  As 
the  requirement  was  originally  written,  the  $30  million  to  $30  mil¬ 
lion  C-5A  aircraft  would  have  been  capable  of  entering  a  rough,  un¬ 
attended  airfield,  and  it  would  have  required  an  advanced  stellar- 
inertial  navigation  system  to  achieve  the  necessary  accuracy  without 
ground-based  navigation  aids.  When  this  requirement  was  questioned 
by  the  R&D  senior  headquarters  staff,  it  was  decided  that  the  C-bA 
could  not  be  used  that  way,  and  the  terminal  navigation  performance 
requirement  was  reduced.  It  remained  stringent  enough,  however,  to 
require  the  development  of  new  technology  (floating -ball  gyro)  for 
the  inertial  navigation  system  (INS),  at  a  great  cost  increase. 

While  the  cost  growth  of  the  INS  was  anticipated  well  in  advance, 
the  Government  could  not  intervene,  because  this  would  have  incurred 
the  penalties  of  disrupting  a  fixed-price  contract  with  the  prime 
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Contract  structure  Prime-sub-sub  compounred  overhead  and  fees 

increasing  cost  40%  in  management  alone 
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TABLE  02.  C-5A  NAVIGATION  SUBSYSTEM 


Cost  Growth 


Oriqinal  Requirement 

Changes.  Before  Approval 

Estimate 

Ultimate 

Radar: 

Terrain  avoidance  &  following. 
Weather. 

Assist  in  checkpoint  navigation. 

Dropped  unattended  airfield 
requirement 

Reduced  accuracy 

Radar: 

$380,000 

Inertial: 

$100,000 

~  $1.5  million 

-  $400, 000 

Accuracy: 

300  ft  at  unattended  airfield  after 
distant  checkpoint 

Allowed  use  of  inertial  system 
only,  with  beacon  for  terminal 
guidance 

New  stellar-inertial  system 


COST  GROWTH 


Sources 


Reasons 


Radar  Specification  for  radar  led  to  poor  matching  of 

pulse  repetition  rates,  pulse  widths,  bandwidth. 
Information  rate  and  bandwidth  not  matched  for 
interferometric  terrain-following  scheme 

Poor  Initial  design  in  light  of  above  problems. 

SPO  insistence  on  adhering  to  SOI 

Inertial  Specification  required  development  of  new  floating- 

ball  gyro  technology;  subcontract  from  prime  to 
subcontractor  for  system;  prime  contract  precluded 
USAF  intervention 
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contractor.  The  radar  performance  requirement  may  also  have  been  ex¬ 
treme  for  an  aircraft  of  this  type  and  mission,  since  it  is  question¬ 
able  whether  it  would  ever  be  put  in  a  position  where  terrain  follow¬ 
ing  is  necessary.  The  system  project  office  was  unwilling  to  reduce 
the  performance  specifications  for  the  radar  to  keep  costs  down.  Yet, 
in  both  cases  (radar  and  INS),  the  argument  could  have  been  made  (and 
later  would  be  borne  out  by  experience  in  Vietnam  with  C-141s)  that 
an  aircraft  of  this  type  and  cost  would  operate  in  a  reasonably  pro¬ 
tected  environment,  therefore  decreasing  the  need  for  a  completely 
self-contained,  ultrahigh-perf ormance  navigation  system. 

C.  AIR-TO-AIR  MISSILES 

This  examination  considered  the  AIM-9  series  of  missiles.  Fig¬ 
ure  C-l  shows  the  progression  of  characteristics  and  costs  with  time 
(the  costs  are  approximate,  having  been  derived  to  a  great  extent  by 
inference  from  fragmentary  data3).  Note  the  division  into  Air  Force 
and  Navy  versions,  resulting  from  an  early  Navy  decision  to  adopt  a 
new  launcher  having  the  cryogenics  for  the  seeker  in  the  launcher 
rather  than  in  the  missile.  Each  Service  was,  as  a  result,  unable  to 
use  the  other's  missiles,  adding  cost,  complicating  inventory  prob¬ 
lems  during  the  Vietnam  war  (at  some  cost  which  could  not  be  esti¬ 
mated),  and  giving  up  some  of  the  cost  reduction  that  would  have  de¬ 
rived  from  extending  the  production  learning  curves.  When  the 
Deputy  Secretary  of  Defense  ordered  compatible  missiles  for  both 
Services,  the  different  Air  Force  and  Navy  launcher  philosophies  re¬ 
quired  the  Air  Force  version  of  the  AIM-9L  missile  to  include  a 
coolant  bottle  in  the  missile,  while  the  Navy  missile  retains  an 
empty  module  with  piping  from  the  launcher.  Missiles  must  be  adapted 
for  each  Service  at  their  respective  depots.  Thus,  by  incidental 
decisions  regarding  requirements  for  launcher  and  missile  types, 
separately  made  in  each  Service,  the  entire  system  has  been  more  ex¬ 
pensive  over  its  useful  life  than  it  would  otherwise  have  been. 
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FIGURE  C-l .  AIM-9  Evolution  (Data  from  Ref.  3;  costs  estimated  from  incomplete  data 
in  Ref.  3  and  normalized  to  1972  dollars;  unit  .'»yaway  cost  estimates 
shown,  not  normalized  for  production  run.  ) 


D.  MAIN  BATTLE  TANK5 

Figure  C-2  shows  the  cost  of  a  succession  of  tanks,  and  the 
division  of  costs  between  the  fire-control  system  and  the  remainder 
of  the  tank.  The  added  fire-control  functions  that  led  to  increased 
costs  are  also  shown.  The  figure  indicates  that  electronic  system 
costs  grew  much  faster  than  those  of  the  remainder  of  the  tank, 
despite  significant  changes  in  armament,  armor,  suspension,  and 
propulsion.  A  significant  aspect  of  how  requirements  statements  can 
be  changed  by  arbitrary  circumstances  is  shown  by  the  difference  be¬ 
tween  the  canceled  XM-803  tank  and  the  new  XM-1  main  battle  tank 
just  entering  development.  From  virtually  the  same  available  in¬ 
formation  (on  infantry  antitank  weapons  to  be  available,  on  anti¬ 
tank  helicopters  in  development,  on  tactical  aircraft  antitank 
weapons  available  or  in  development,  and  cn  projected  Soviet  tank 
numbers  and  characteristics),  it  was  decided  that  the  XM-803  needed 
a  missile  for  the  antitank  defense  role,  while  the  XM-1  did  not  need 

it,  since  the  XM-1  would  operate  in  an  offensive  role  only  and  other 

6 

antitank  systems  would  defend  it  against  tank  attack.  The  driving 

force  in  this  change  of  outlook  was  the  Congressional  instruction 

on  how  much  the  tank  should  cost.7  In  addition,  the  earlier  approach 

to  the  day-night  sight,  which  was  an  important  factor  in  XM-803 

8 

fire-control  system  cost,  was  expensive.  This  cost  will  be  reduced 
in  the  XM-1,  since  thermal  imaging  has  become  available  to  replace 
the  laser  technology  that  was  initially  pursued.  It  can  be  supposed 
that  if  the  tank  had  been  developed  using  state-of-the-art  fire- 
control  technology,  with  later  incorporation  of  more  advanced  tech¬ 
nology  after  it  was  proven,  the  overall  costs  would  have  been  lower. 
The  historical  outcome  suggests  that  the  electronic  subsystem  de¬ 
velopment  should  not,  in  this  case,  have  been  tied  to  the  IOC  of  the 
main  tank  assembly. 

E .  ARMED  HELICOPTER 

This  case  was  examined  in  the  greatest  detail  of  all  the  ex¬ 
amples  considered  here  because  it  is  of  current  interest,  the  data 
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were  available,  and  the  armed  helicopter  was  found  to  typify  many 
current  major-system  requirements  problems.  The  following  discussion 
is  not  meant  to  critique  the  Army's  program,  since  the  program  is  a 
current  design-to-cost  program  and  is  considered  to  be  well  and  care¬ 
fully  managed.  The  information  and  discussion  are  presented  for 
their  intrinsic  interest  and  as  lessons  in  the  requirements  process. 
The  main  concern  here  is  with  electronics;  other  factors  will  be 
mentioned  when  relevant. 

Current  Army  armed  helicopters  date  back  to  the  early  1950s, 

having  begun  with  the  H-21  and  H-40  series  transport  and  utility 
g 

helicopters.  The  H-40  became  the  UH-1  and,  after  considerable  ex¬ 
perimentation,  acquired  a  succession  of  standard  armaments  for  combat 
in  Vietnam.  The  UH-1  was  modified  to  become  the  COBRA,  and  improve¬ 
ments  of  the  latter  are  to  be  extended  into  the  future  Army  force 
structure.  The  COBRA,  at  the  end  of  a  long  line  of  development,  has 
growth  limitations.  The  attempt  to  initiate  a  new-generation  mach¬ 
ine  led  to  the  AH-56  CHEYENNE,  which  was  canceled  because  its  unit 
cost  became  too  high.  The  requirement  for  the  AH-56  did  not  specify 
the  fire-control  system  in  detail,  and  that  subsystem  evolved  during 
development.  Additions  included  such  equipment  as  a.  laser  range¬ 
finder/designator,  TOW  fire  control,  a  helmet  sight,  and  an  advanced 
fire-control  computer. ^  Of  a  development  overrun  of  $205  million, 
about  $110  million  was  due  to  changes  resulting  from  engineering  and 
design  problems.  While  much  of  this  was  due  to  rotor  instability 
at  high  sp^ed,  some  was  attributed  to  the  addition  of  TOW,  night- 
vision  systems,  and  avionics  changes. 11  In  addition,  it  was  found 
(among  other  problems)  that  of  a  $49.5  million  GSE  buy  necessary  to 
support  the  first  15  aircraft,  $26  million  would  have  been  required 
for  test  sets  for  the  Doppler  heading -attitude  reference  system  (the 

expenditure  was  deferred).  These  test  sets  had  not  been  anticipated 

12 

when  the  Doppler  navigation  system  was  chosen. 

The  Army  attempced  to  rectify  these  problems  when  the  new  Ad¬ 
vanced  Attack  Helicopter  (AAH)  was  planned.13  Table  C-3  lists  some 
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key  requirements  areas  contained  in  the  DCP  for  the  AAH.  These  are 

14 

expanded  in  the  "materiel  need"  document,  which  gives  fire-control 
and  related  avionics  specifications  in  more  detail  than  was  the  case 
for  the  AH-56.*  Table  C-4^  shows  the  bases  of  choice  among  com¬ 
peting  systems,  presented  in  the  DCP,  leading  to  the  recommendation 
for  a  new  AAH  development  as  the  preferred  choice  over  two  other 
alternative  systems  based  on  existing  aircraft.  Table  C-51"^  lists 
several  areas  in  which  attempted  adherence  to  the  requirements  could 
lead  to  increased  costs,  and  also  in  which  the  choice  of  the  pre¬ 
ferred  aircraft  could  be  reversed  if  projected  cost-effectiveness 
were  the  only  basis  of  choice.  It  will  be  noted  that  the  desired 
kill  probability  against  tanks  is  more  optimistic  than  data  from 
simulated  field-test  engagements  between  armed  helicopters  and  tank 
companies  would  suggest,  and  that  predicted  exchange  ratios  from 
those  tests  are  lest-  optimistic  than  the  ratios  forecast  for  the  new 
machine  in  the  DCP.  In  the  case  of  mission  reliability,  the  data 
that  might  support  the  reasonableness  of  the  requirement  do  not  exist. 
Note,  also,  that  the  new  aircraft  was  claimed,  in  the  DCP,  to  entail 
lower  development  risk  than  would  a  further  adaptation  of  the  COBRA. 
Although  good  reasons  why  this  might  be  so  were  given,  risk  as  such 
was  stated,  without  backup,  as  "high,"  "medium,"  or  "low."  Prima 
facie,  the  proposition  is  counterintuitive. 

Thus,  without  arguing  that  the  wrong  choice  was  made,  or  that 
the  planned  aircraft  development  cost  or  unit  acquisition  cost  will 
be  overrun,  it  is  apparent  that  the  design  may  be  difficult  to  hold 
to  cost  unless  there  is  great  management  flexibility  to  adjust  the 
requirements,  and  unless  management  is  aware  of  the  pitfalls  and 
monitors  the  development  closely.  Note  that  total  force  procurement 
plans  include  both  alternatives,  so  that  in  any  case  the  Army's  op¬ 
tions  will  be  retained. 

•it 

Ten  statements  described  specified  fire-control  functions  for  the 

AH-56,  as  opposed  to  21  statements  for  the  AAH,  based  on  Ref.  14 

and  the  AH-56  QMR. 
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TABLE  03.  KEY  ADVANCED  ATTACK  HELICOPTER  REQUIREMENTS 
(Quantitative  values  not  shown) 


1.  Agility 

2.  Armor  protection 

3.  Overall  system  reliability  for  _ -hr  mission,  _ % 

4.  Weapon  P^,  associated  with  conditions  (day,  night, 
weather,  target  and  behavior) 

5.  Night -ope rating  systems  and  fire  control 

•  Specified  separately  for  pilot  and  copilot -gunner 

•  Detection  and  recognition  ranges,  by  condition  and 
target 

•  Displays  described 

•  Field  of  view  and  resolution  specified 


TABLE  C-4.  BASES  FOR  CHOICE  AMONG  THREE  ADVANCED  ATTACK 
HELICOPTER  ALTERNATIVES 


•  One  existing  system  ruled  out  for  reasons  of: 
-  Cost,  competition,  other  limitations 


•  Between  other  existing  system  (improved)  and  new  system: 


-  New  system  more  agile 

-  Vulnerability  / 

-  Cost-effectiveness ) 


New  system  costs  more  but 
is  more  cost-effective 


-  New  system  has  more  performance  flexibility 

New  system  has  less  technical  risk  (reasons  given  in¬ 
volve  systems  integration  and  potential  structural 
problems  ) 

-  New  system  has  more  growth  potential 
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TABLE  C-5.  ADVANCED  ATTACK  HELICOPTER:  AREAS  THAT  CAN 
DRIVE  COST  OR  REVERSE  SYSTEM  CHOICE3 


1.  (and  conditions)  in  DCP 
all  differ  and  are  all  higher  than  demonstrated  in  OT&E 
simulating  combat 

2.  Weather  and  detection/recognition  probabilities  for  E/0 
systems  not  specified;  could  lead  to  overdesign  for  :’orst 
conditions 

3.  Mission  reliability  specification  based  on  theoretical 
MTBF,  not  supported  by  data  for  simpler  systems  in  SEA 

4.  Fire  control  and  avionics  can  be  complicated  by  armor 
specification  affecting  internal  configuration  of  aircraft 

5.  Exchange  ratio  from  OT&E*3  differs  enough  from  exchange 
ratio  from  the  models  used  for  justification  to  make 
competing  systems  equally  cost-effective  within  the 
uncertainty 

6.  Risk  may  be  underestimated  for  new  system,  in  terms  of 
unanticipated  problems  versus  known  problems  for  exist¬ 
ing  system 


,  requirement  docume^  and  RFP 


aNot  discernible  from  DCP,  alone. 
^Simulated  helicopter-tank  combat. 
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F .  LORAN  D 


16 

LORAN  C  was  designed  for  overwater  navigation  to  provide  a  great 
increase  in  accuracy  over  the  original  LORAN  A  hyperbolic  navigation 
system.  In  LORAN  C,  position  was  determined  by  referring  time-dif¬ 
ference  readouts  to  specially  prepared  charts.  It  was  noted  that  the 
system  could  be  adapted  for  overland  use  and  would  provide  tactically 
usable  accuracies,  at  shorter  range,  if  a  shorter  transmitter  base¬ 
line  were  used,  with  corresponding  changes  in  pulse  repetition  rate 
and  signal  structure,  and  with  signal  sampling  point  delayed.  This 
revised  system  was  designated  LORAN  D.  In  addition,  the  Air  Force 
decided  to  incorporate  automatic  tracking,  continuous  coordinate- 
conversion  by  computer,  and  advanced  integrated  circuits  to  reduce 
the  size  and  weight  of  the  airborne  equipment.  The  new  equipment 
was  tested  at  Eglin  Air  Force  Base  and  demonstrated  problems  that 
could  not  easily  be  separated  because  the  basic  design  of  the  LORAN 
receivers,  the  system  functions,  and  the  electronic  technology  had 
all  been  changed  simultaneously. 

Thus,  when  a  navigation  system  was  needed  in  Vietnam,  the  Army 
installed  DECCA,  which  had  less  accuracy  but  was  an  available,  oper¬ 
ating  system.  At  the  same  time,  continuing  LORAN  D  problems  were 
raising  the  cost  for  the  airborne  equipment  (receiver  plus  computer) 
to  about  four  times  the  original  estimate.  By  a  special  effort, 
stimulated  by  the  Air  Force  R&D  senior  headquarters  staff,  the 
avionics  cost  was  reduced,  although  not  to  the  original  value. 

(That  was  retched  in  subsequent  years.)  However,  there  was  as  yet 
"no  requirement." 

At  this  point,  the  Defense  Communications  Planning  Group,  need¬ 
ing  an  accurate  navigation  system  for  emplanting  and  locating  sensors 
on  the  Ho  Chi  Minh  Trail,  requested  that  the  Air  Force  install  LORAN 
in  Southeast  Asia.  LORAN  C  transmitters  were  used.  One  squadron  of 
F-4s  equipped  with  the  ARN-92  LORAN  D  receiver,  which  could  also 
receive  and  use  LORAN  C  signals,  was  deployed  in  1968.  Later,  two 
more  squadrons  were  equipped,  for  night  bombing  in  conjunction  with 
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sensor  information.  Currently,  LORAN  D  is  one  of  the  systems  for 
radio  navigation  that  is  being  considered  for  Air  Force  and  Army  use 
in  Europe,  for  auxiliary  updating  of  inertial  systems,  for  use  by 
ground  troops,  and  for  other  applications. 

One  feature  of  the  development  was  the  fact  that  at  no  time  was 
the  annual  program  cost  high  enough  to  make  the  development  visible 
as  a  "major  system."  Therefore,  those  in  the  Air  Force  who  saw  its 
potential  value  were  able  to  fund  it  as  an  independent  development, 
illustrating  the  value  of  leaving  "openings"  in  control  of  develop¬ 
ment  funds  to  allow  for  innovation. 

G.  PAVE  SPIKE 

PAVE  KNIFE  was  the  original  laser  designator  pod  designed  for 
F-4  delivery  of  laser-guided  bombs  (LGBs)  and  deployed  to  Southeast 
Asia.  PAVE  SPIKE  is  the  improved  version — smaller,  better  fitted  to 
the  aircraft,  and  with  greater  capability  to  assist  F-4  weapon  de¬ 
livery.  The  original  PAVE  KNIFE  pods  were  R&D  items.  When  the  Air 
Force  wanted  additional  pods,  it  was  initially  quoted  a  production 
price  of  approximately  $500,000  per  pod.  Therefore,  it  was  decided 
to  hold  a  competition  for  a  new  production  system,  which  resulted  in 
the  December  1970  award  of  a  $3.3  million  fixed-price,  total-package- 
procurement  development  contract  for  three  prototype  pods,  appro¬ 
priate  F-4D  modifications,  and  two  sets  of  prototype  AGE.  The  asso¬ 
ciated  promotion  cost  bid  in  the  development  contract  was  between 
$100,000  and  $200,000  per  pod  f or  a  production  buy.  There  was  a 
contract  time  limitation  on  the  production  options,  and  the  develop¬ 
ment  contract  did  not  include  a  reprocurement  data  package  until  a 
production  option  was  exercised.  Thus,  when  the  Air  Force  decided 
to  freeze  the  R&D  design  in  June  1972  and  to  acquire  a  modest  number 
of  pre-production  pods  for  a  quick-reaction-capability  Southeast  Asia 
combat  requirement,  it  was  not  in  a  favorable  position  to  hold  a  pro¬ 
duction  competition.  The  pre-production  pods  cost  more  than  twice 
the  original  (tentative)  production  bid  price  associated  with  the 
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maximum  production  option.  Current  plans  are  to  acquire  a  large  pro¬ 
duction  quantity  of  pods  and  to  modify  a  number  of  F-4s  to  use  them. 
The  price  for  the  pods  alone  is  now  less  than  $200,000  each.  The 
total  production  contract  also  has  "not-to-exceed"  costs  lor  ECPs, 

AGE,  aircraft  modification  kits,  and  a  data  package."^7 

Although  the  above  procurement  represents  final  Air  Force  plans 
at  the  time  of  writing,  the  additional  quantities  of  LGB  delivery 
systems  that  might  be  acquired,  it  may  be  inferred,  nevertheless  re¬ 
main  uncertain,  as  a  result  of  potential  application  to  other  air¬ 
craft.  For  example,  pods  may  ultimately  be  desired  for  use  on  such 
aircraft  as  the  F-lll  and  A-6.  The  pod  is  designed  for  use  on  two- 
seat  aircraft;  automatic  target  tracking  would  be  needed  for  the 
system  to  work  with  the  A-7  (a  single-seat  aircraft)  or,  later,  the 
A-10,  if  the  A-10  enters  the  force.  Providing  a  two- seat  version  of 
such  aircraft,  or  using  any  two-seat  aircraft  with  a  pod  to  designate, 
could  also  enable  single-seat -aircraft  LGB  delivery,  and  would  be 
necessary  if  the  pod  is  not  modified.  For  such  additional  uses, 
additional  costs  are  in  the  offing  due  to  uncertain  current  program¬ 
ming  of  the  total  number  of  LGB  delivery  systems  and  associated  air¬ 
craft  modifications.  Thus,  although  the  LGB  capability  exists  and 
is  proven,  DOD  cannot  take  full  advantage  of  the  potential  cost 
savings  of  a  long  production  run  and  efficient  aircraft  design  modi¬ 
fications  for  use  on  all  of  the  relevant  aircraft  of  all  Services, 
because  plans  for  incorporating  the  capability  in  the  total  DOD  force 
structure  have  not  been  made.  (Of  course,  it  may  not  be  possible  to 
make  such  plans,  and  other  costs  could  be  incurred  while  attempting 
to  save  in  this  area,  if  there  is  insufficient  prescience  about  what 
will  be  required  in  each  aircraft  system. ) 

1  ft 

H.  COMPASS  EAGLE 

This  program  illustrated  how  costs  can  be  incurred  indirectly 
when  a  capability  exists  but  is  not  used  because  there  is  "no  require¬ 
ment."  COMPASS  EAGLE  attempted  to  improve  the  quality  of  information 
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obtained  by  infrared  (IR)  scanners  on  reconnaissance  aircraft.  COM¬ 
PASS  EAGLE  was  undertaken  in  the  mid-1960s  as  a  joint  ARPA-RADC(USAF) 
effort,  and  one  of  its  outputs  involved  substitution  of  magnetic 
tape  for  the  normal  film  on  which  IR  data  are  recorded.  The  data 
could  then  be  read  directly  from  the  tape,  leading  to  about  a  three¬ 
fold  improvement  in  resolution  (i.e.,  permitting  the  scanner  to 
operate  near  its  design  resolution,  which  did  not  normally  occur). 
With  the  hardware  development  went  the  devel'nnent  of  photo-inter¬ 
pretation  techniques  to  make  better  use  of  the  IR  "take,”  since  it 
had  been  observed  that  normal  IR  reconnaissance  yielded  little  useful 
data,  especially  in  relation  to  the  expenditures  for  the  missions. 

The  COMPASS  EAGLE  system  was  flown  in  Vietnam  as  part  of  an 
RB-57  reconnaissance  system  test,  and  its  effectiveness  (including 
the  potential  gain  in  the  utility  of  the  IR  data)  was  demonstrated. 
However,  the  7th  Air  Force  did  not  express  a  requirement  for  it,  and 
therefore  it  was  used  only  for  the  R&D  and  demonstration  flights. 

The  cost  of  modifying  two  squadrons  of  RF-4  aircraft  to  incorporate 
the  new  capability  would  have  been  about  $500,000;  the  RDT&E  cost 
was  about  $3.5  million.  The  estimated  cost  of  the  IR  reconnaissance 
missions  of  those  squadrons  for  3  years  might  have  been  about  $25 
million.*  Thus,  the  expenditure  of  about  $4  million  could  have 
greatly  improved  the  effectiveness  of  about  $25  million  spent  on 
operations,  but  was  not  undertaken  for  lack  of  a  formal  "require¬ 
ment  . " 

I.  E-2C  AIRCRAFT19 

The  key  steps  in  the  development  of  this  program  are  shown  in 
Table  C-6.  While  this  program  was  originally  examined  in  this  study 


Estimate  of  $25  million  assumes:  five  infrared  reconnaissance  sor¬ 
ties  per  day,  at  1  to  2  hours  each;  O&M  cost  of  $1000  per  flying 
hour;  0.1  percent  attrition  of  RF-4,  at  about  $3  million  each;  3 
years  of  operation;  and  $300,000  per  year  for  operation  of  IR  part 
of  reconnaissance  data  interpretation  and  analysis  center. 
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simply  to  ascertain  what  fraction  of  the  program's  cost  has  been  de¬ 
voted  to  electronics,  an  aspect  of  the  program  emerged  that  makes  it 
relevant  in  the  context  of  the  roquirements-aequisition  decision 
process.  The  E-2A  aircraft  was  operated  with  the  APS-9S  search  radar 
(state  of  the  art  about  1960)  for  sea  search  while  development  of  a 
new  radar  with  an  overland  capability  proceeded  separately.  When  a 
new  radar  (APS-111)  emerged  from  development  (in  which  there  had 
been  informal  competition  between  two  sources),  this  was  put  into 
production  as  the  APS-120  for  the  E-2C.  Thus,  a  wholly  new  capa¬ 
bility  for  the  system  mission  was  integrated  into  an  existing  plat¬ 
form.  The  platform  power  plant  was  uprated  in  thrust  at  the  same 
time,  but  development  of  a  completely  new  system  was  found  to  be 
unnecessary. 

TABLE  C-6.  KEY  POINrS  IN  E-2C  HISTORY 

•  Initial  operational  capability,  E-2A:  1964 

•  Improved  computer,  E-2B:  1959 

•  Studies,  one  funded  by  DOD  and  one  contractor- 
funded,  cf  overland  radar:  1960-61 

•  AN/APS -111,  RDTSE:  1963-1966 

•  AN/APS-120,  production  radar  testing 
completed:  1969 

•  Initial  operational  capability,3  E-2C:  1973 


aIncludes  engine  and  navigation  system  upgrade. 
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SOURCE  DATA  FOR  FIGURE  II -5 


Unit 


Item 

Nomenclature 

Production 

Cost, 

dollars 

Relia¬ 

bility, 

MFHBF 

Source 

1 

51Z3  Marker  Beacon 

$  372 

2,045 

Ref.  1 

2 

ARN-18  Glide  Slope  Indicator 

450 

772 

Ref.  1 

3 

ARN-31  Glide  Slope  Indicator 

852 

756 

Ref.  1 

4 

ARN-32  Marker  Beacon 

1,038 

857 

Ref.  1 

5 

ARN-12  Marker  Beacon 

1,757 

941 

Ref.  1 

6 

ARN-67  Glide  Slope  Indicator 

2,381 

1,623 

Ref.  1 

7 

51R-6  VOR 

3,069 

1,259 

Ref.  1 

8 

51V4/WIL-800B  Glide  Slope 
Indicator 

2,550 

918 

Ref.  1 

9 

ARN-58A  VOR 

1,896 

443 

Ref.  1 

10 

APX-64  IFF 

2,891 

567 

Cost:  Ref.  : 
Reliability 
Ref.  1 

11 

FM-622A  VHF  Communication 
System 

3,348 

556 

Ref.  1 

12 

DFA-73B  Direction  Finder 

3,380 

351 

Ref.  1 

13 

WIL-807A  VHF  Communication 
System 

3,780 

355 

Ref.  1 

14 

WIL-806A  VOR 

3,069 

275 

Ref.  1 

15 

HF-102  HF  Communication 

System 

4,579 

288 

Ref.  1 

16 

ARN-14  VOR 

4,906 

265 

Ref.  1 

17 

VOR-101  VOR 

6,365 

300 

Ref.  1 

18 

HF-101  HF  Communication 

System 

8,270 

342 

Ref.  1 

19 

CP-953/ASQ,  A-7E  Air  Data 
Computer 

8,000 

258 

Ref.  3 

20 

DFA-70B  Direction  Finder 

6,073 

170 

Ref.  1 

21 

VHF-101  VHF  Communication 
System 

8,270 

206 

Ref.  1 

22 

ARC-90  UHF  Communication 
System 

13,700 

242 

Cost:  Ref.  : 
Reliability 
Ref.  1 

Praniiig  page  Mink 
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SOURCE  DATA  FOR  FIGURE  II-5  (Continued) 


Unit 


Item 

Nomenclature 

Production 

Cost, 

dollars 

Relia¬ 

bility, 

MFHBF 

Source 

23 

APX-25  IFF 

$  1,962 

126 

Ref.  1 

24 

APN-70B  LORAN 

2,686 

72 

Ref.  1 

25 

ARC-34  UHF  Communication 
System 

4,594 

83 

Ref.  1 

26 

ARN-21C  TACAN 

5,929 

91 

Ref.  1 

27 

ARC -13 3  UHF  Communication 
System 

5,332 

67 

Ref.  1 

28 

ARN-52  TACAN 

7,376 

54 

Ref.  1 

29 

ARN-58  HF  Communication 

System 

10,486 

78 

Ref.  1 

30 

ARC-109  UHF  Communication 
System 

11,180 

71 

Ref.  1 

31 

ARC-105  HF  Communication 
System 

11,700 

121 

Ref.  1 

32 

ARC -6 5  HF  Communication 

System 

18,000 

83 

Ref.  1 

33 

ARC-112  HF  Communication 
System 

22,576 

86 

Ref.  1 

34 

APN-147  Doppler  Navigator 

22,794 

73 

Ref.  1 

35 

APN-81  Doppler  Navigator 

20,435 

113 

Ref.  1 

36 

C-8185/AWE  A-7E  Armament 
Station  Control 

24,000 

121 

Ref.  3 

3/ 

APN-151  LORAN 

41,639 

102 

Ref.  1 

38 

APN-89  Doppler  Navigator 

18,804 

60 

Ref.  1 

39 

ASN-99  A-7E  Map  Display 

26,000 

42.6 

Ref.  3 

40 

APN-157  LORAN 

36,226 

43 

Ref.  1 

41 

APN-190  A-7E  Doppler 

Navigator 

24,000 

20.6 

Ref.  3 

42 

AVQ-7  A-7E  Head-Up  Display 

42,000 

31.6 

Ref.  3 

43 

APN-59B  Weather  Radar 

45,000 

35 

Ref.  4 

44 

ASN-90  A-7E  INS 

61,000 

38.4 

Ref.  3 

45 

ASN-91  A-7E  Navigation/Weapon 

101,000 

68.6 

Ref.  3 

Computer 
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SOURCE  DATA  FOR  FIGURE  II-5  (Continued) 


Item 

Nomenclature 

Unit 

Production 

Cost, 

dollars 

Relia¬ 

bility, 

MFHBF 

Source 

46 

APQ-126  A-7E  Radar 

$  71,000 

8.9 

Ref. 

3 

47 

APN-92  LORAN 

113,000 

8.4 

Ref. 

1 

48 

APQ-120  Complete  Fire 
Control 

152,000 

12 

Ref. 

4 

49 

AWG-10  Radar  and  Fire 
Control 

312,000 

3.8 

Ref. 

4 

50 

APQ-113  Radar 

218,000 

29.5 

Ref. 

4 

51 

RDR-1F  Wearher  Radar 

25,000 

1,259 

Ref. 

4 

52 

CAROUSEL  IV  EC-134J  INS 

100,000 

2,208 

Ref. 

5 
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DISCUSSION  OF  WEIGHTING  METHOD  EMPLOYED  IN  CALCULATING 
AVERAGE  PROGRAM  COST  GROWTH  AND  ITS  STANDARD  DEVIATION 


Tables  III- 2  and  III- 3  show  the  program  cost  growth  of  a  number 
of  weapons  systems  in  development  and  production.  Table  III- 2  shows 
cost  growth  duping  4  years  of  development,  and  Table  III- 3  shows  cost 
growth  during  4  years  of  production.  Cost  growth  is  measured  from 
the  earliest  available  estimate--f rom  the  planning  estimate,  if  it  is 
available;  otherwise,  from  the  development  estimate. 

Because  of  the  nature  of  the  data  and  the  fact  that  for  any  given 
time  data  are  usually  unavailable  for  some  program  or  programs,  the 
summary  calculations  are  based  on  a  slightly  changing  mix  of  programs. 

To  provide  a  reasonable  perspective  of  program  cost  growth  with¬ 
out  overemphasizing  the  importance  of  the  small  programs,  a  mean  and 
a  standard  deviation  were  calculated  for  each  set  of  data  by  a  least- 
squares  procedure  in  which  each  program  was  weighted  in  proportion 
to  its  initially  estimated  cost.  The  weighting  is  explained  below. 


The  following  notation  was  used: 

i  denotes  the  particular  program  on  the  ith  line  of  the  table. 


n  is  the  number  of  programs. 


is  the  planning  estimate  of  the  cost  of  the  i*"*1  program.  If 
no  planning  estimate  is  available,  the  development  estimate 
c<d>  is  used  in  its  stead. 


cP^  is  the  current  estimate  of  the  cost  of  the  ith  program 

cfd^  is  the  development  estimate,  ci^  is  the  current  esti 

1  1  (2) 
mate  during  the  first  reported  year,  c^  is  the  current 

estimate  during  the  second  reported  year,  and  so  on. 


Thus, 
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x<k)  =  c<k)  -  is  the  estimated  cost  growth  of  the  ith  program 
from  its  initial  cost  estimate. 

u<k)  =  x^Vp^  is  the  estimated  cost  growth  of  the  ith  program 
expressed  as  a  fraction  of  the  initial  cost  esti¬ 
mate. 

w^  is  the  weighting  factor  associated  with  the  ith  program  to 
make  up  for  the  fact  that  different  programs  entail  different 
amounts  of  money.  The  weighting  is  proportional  to  the  initial 
estimate  of  the  dollar  value  of  each  program.  Thus, 


w. 

1 


Pj/np  , 


where 


Note  that 

n 

Z>i  =  1  • 

3=1 

Note  that  p  must  be  computed  individually  for  each  set  of  data, 

because  the  data  are  incomplete,  and  not  all  programs  are  reported  in 

(lO  fk') 

every  set.  Thus,  the  correct  expression  is  really  p'  ' .  Also,  nv 

no 

must  be  used;  consequently,  w^  -  w^  . 

The  two  important  characteristics  of  the  sample  are: 

1.  The  average  program  cost  growth  trend  line,  points  on  which 
are  given  by 
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<U«>=  £  w<k>uf>  = 

i=l 

f  \ 

0 

where  one  has  the  definition: 

) 

n00 

500  =  _L_  V  ' 

3=1 

1 

1 

,oo 
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2.  The  standard  deviation  from  the  points  on  the  cost -growth 
trend  line,  which  is  given  by 


,00  - 
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00 


E 

i=l 


w<k>  [u<k>  -  <u<k>>]2 
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The  expression  for  the  mean  cost  growth  (uv  ')  is  that  which  mini- 

(k  )  2 

mizes  the  weighted  variance  [o'  , 

In  Figs,  III-l  and  III-2,  which  are  graphs  corresponding  to 
Tables  III-2  and  III-3,  respectively,  the  several  means  are  connected 
by  straight  line  segments,  1.  a  points  representing  one  standard  devi¬ 
ation  on  each  side  of  the  means  are  similarly  connected.  The  result¬ 
ing  trend  lines  indicate  the  course  of  the  average  program  cost  growth 
with  time  during  development  (Fig,  III-l)  and  production  (Fig,  III-2). 
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